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INTRODUCTION TO THIS VOLUME 

This docufnent^ls the second .1n a sei^les of three reports of the 
1976-77 evaluation of the Hawaii 3 on 2 Program. Volume I. Technical 
• Report , Is a comprehensive, detailed r^porlf which described the evalua- 
♦tion deslfln, data collection and analysis procedures and results. 
Volume I Is intended for the limited audience who require detailed 
information about the specifics of'any aspect of tKe'evaTuation." 

This volume, Team Interpretations and Recommendations , contains 
the major arguments for and agairvst the 3 on 2 Program. Because of the 
high visibility of the 3 on 2 Program, the Hawa'ii Department of Educa- 
tion requested a comprehensive evaluation to assess not only the Program' 
strengths but also the deficiencies. This request led the Department 
and the Northwest Regional Educational Laboratory to select the advocate- 
adversary approach as the basis for evaluating the 3 on 2 Prograir^, 

The purpose of the volume is to present the reports of the Advocate 
and Adversa»»y Teams as well as their rebuttals. 

^The purpose of Volume III. Executive Summary is to provide an. over- 
view of the procedures, findings, interpretations', and recommendations 
given in Volumes I and U. It is anticipated that the Executive Summary 
will have the broadest general appeal and distribution. 

Organization- of This Volume . 

The remainder of this volume contains the folljDwing sections: 
1. The report of the Advocate Team 
2.. The report of the Adversary Team. 

3. The rebuttal of the Advocate Team 

4, The rebuttal of the Adversary Team 
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PREFACE 

1 ■ 



The authors of this- report were assigned the task of serving as 
advocates of the Instructional program belng'evaluated. They perceived 
(their assignment, consistent with the adversarial evaluation model 
being employed, to defend the merits of that program as vigorously 
as possible on t^he basis of available evidence, logic, etc. yryshouTd 
be recognized, therefore, that the positions expressed in the follow- 
Ing pages may not represent the individual or collective views of the 
wrHers. v 
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Hawaii's 3 on 2 Program r«preient$ tht most imbltlouJ attempt ever 
seen In American educational history to create a team-taught, flexible, 

t 

and Individualized Instructional program for primary grade children. 
Since Its establishment 1n'1968, the Hawaii 3 on 2 Prcfgram has attracted 
the attention of many educators, not only fn the United States but In the 
larger International community. Never before has an entire state 

attempted,- at. this magnitude, to Install a comparable InstrAJctlonal 

scheme designed to upgrade the quality of Jts Instructional efforts for ^ 
primary grade youngsters; . , • 

This report constitutes one segment of^ a syst^atlc attempt to eval- 
uate the merits of the HAwall 3 on 2 Program. Hawaii's educatlona-1 
policymakers are now faced with a series of significant decisions regarding 
the Hawaii 3 on 2 Program, that Is, whether to (1) expand It, (2) maintain 
it at Its present level, (3) reduce it, or (4) eliminate it. If a 
decision is made to retain the program in some form, corollary decisions 
may need to be made regarding how to improve it. Hopefully, this report 
will aid those decision-makers who must make these enormously ' important 
choice's. . • , ' 

An Adult Perspective: A Child's World 

'Adults who determine policy about educational programs should nev^-^ 
forget that they are, in reality, grownups making deci-sibns for children. 
It's all too easy for such adult decision-makers to focus on test scores, 
budgetary factors, or political considerat1ons--and to forget that their 
decisions can virtually refashion a child^s environment. 

Too often we reach educational decisions from the vantage pofnt of 
maturity, a vi^ta' which carries with it all sorts of divicfends, but yet 
some deficits. Let's spin bditk our personal time clocks and try to recall 
« 
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what It's like to be an elgh^-^t^P-old, orice aa«^: After llii we'rf^ 
Intruding on the lives of just such children w.it;h our'/educatlonal /pJol 1 
Let's see how school looks when youVe only three f?*t tatt 'Instead of. ■. 
five or six. Presented below are two f let l^lous. stbrles/.t^at rni^ht big' 
told 'by different second grjKje fiuplls on the topic "A [is,y. in My S<?hod1." 




One of the stories should sound fairly falnlllar fo most readers' of tills 

/ . ■ .- - 

- . ■ . ■ . " 

report. ^ 

A Day In My Sghool " 

by , • 

Lee Cheng (Age 8) 

A day in my sthool is a lot of fun,, at least some of the time. 

My^teacher Is Miss Tanalia arid she Is very nice. She works, hard to 

teach us lots, of thing^.^ 'I sit 'at Table Two. The kids -.who h/ive ^ 

trouble with their reading sit at Tabl« One aryi 1%f^ef Two'ji Sometimes,"' 

when M1ss Tanaka can q&X the rgs^ of the class dffn^'Sther things , 

■ # ' A. . 

get special help in reading. *I;11ke those times because I really 



want to learn how to read. My Mom and Dad try'to help me, but M1sS*1.i' 
Tanaka is more patient. M(5m and Dad get ^o angry when I miss words. ' 
The rest of the class sometimes acts ^p when Miss Tanaka works with 
kids at Table One and TwO. I wisb they would behave themselves ^ ^ 
because Miss Tanaka gets upset and has to stop our special lessons. 

It was very bad in class on Monday and Tuesday because Miss 
Tanaka was absent. We had a suT^stitute teacher and she didn't do 
any of the things we usually do. I don't think I leaVned much on 
those two days, . . . * 

I'm having lots of trouble with arithmetic, Miss Tanaka tries 
so hard to teach us about arithmeTtic, but most of the kids don't^^t^ 
it. She is so nice, but sometimes I think she gets mixed up about 
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ar1thm«t1^. Sheitven says that she never did well 1n arithmetic' 

' . ' / ^ I 
herself when she" wai In school. 

•' ■ • / - ■ . 

Even with the hand time !'# having In arithmetic and readln^f-, 1/ 
sure Tike this class better -than first grad^. Cast year I was In 
Mrs. Hill 's- class for first grade ind she was so mean! None of "the 
kids l.iked her. She-must have been at 6ur scfhool for^yifr.' I'll bet 
I 'm having so much trouble with rtiy reading now because, of ,M^^^ . 
I didn't l^arn anything fromvher. Nobody did. 

A Day in My School 

by ^" 
Pat Carson (Age 8) 

I am in a class in school with three teachers and lots ^f kids. 

Some of them are second graders like me and some of them are third 

graders. Our teachers are Mrs. Nobora, Miss 01 sen, and Mrs. Lee. 

Mrs. Nobora and Mi.ss 01 sen are real ly great, but I can't stand Mrs. 

■ ■ ■ ■ • Y 

Lee. Spme of my friends like her, but I sure don't. She Is go6d 

when she teaches us about music ai^d art, but she doesnH seem friendly 

at other, times. I'm glad I can spend more time with my other twc^ 

teachers. 

Yesterday we spent lots of time in small groups working on 
arithmetic. The teachers have us io three groups for reading, and 
three different groups for arithmetic. I'm in the top group in 
reading and in the middle group in arithmetic. Our arithmetic group 
was having trouble with one kind of story problem, so our teachers 
^changed the schedule so we coujd work with Miss 01 sen for an extra 
period. Tomorrow we will pair off with the kids in t^\^^top arith- 
metic group so they can give us practice in how to work this kind of 
problem. I usually get arithmetic help from Tom. I like it when he 
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tutori me 1n how to do subtracting. I often help Bill when he goes 
through* His wQrd recognition cards. It makes me feel good to htflp 
him. . 

The tf),1rd graders a're a big help In our class. They have been 
In the class for two years now and know how everything goes on.. They 
help the teachers run things. It will be fun to be a third grader 
1n this class next year. I'll get to tutor other kids and maybe I 
can help w1th<|:he attendance records. . \ 

Miss 01 sen had to take her sister to the hospUal ^.three days 
ago. We had a substitute for her, but the other two teachers knew 
what to do and class went on just like it usually does. Mrs. 'Nobora 
even had time to work on reading with me alone agairl. She does this 
a lot. has shown me special way^'to figure out how to read hard 

words. She is sure good at teachi/g kids how to read. She does that 
most of the time in our class, 

With^ three teachers we do so many different things. We have 
small groups and big groups and we'^work by ourselves. Next week half 
of the class is going to a concert with Mrs- Lee^ The rest of the 
class will go to a concert a week after that. I'm going next week. 
It won't be so bad going to a concert with Mrs, Lee. She sure knows 
her music. 

My class is so interesting. Last year I was in a class with one 

teacher. It was okay, but this class is so much better. I can^ t 

wait to get to school each day. 

/ . + ★ * 



Self -Contained Clas^^s-rSelf-Creaf d Problems 

Most readers of this report 'went through elen)entary school at a time 
when t>\ey wefe far" more apt to enc(7unter the situation depicted In the 

first story than the second. When most of today's adul ts« experienced 

- • * ; ■' ■ . . • 

/ 

- elementary school, there were no Classroom organizational choices. We 
*■ >l1.went Into a self-contained class with one teacher In charge. If we 
were lucky, we-drew a good teacher and we learned. If we drew a weak 
teacher, just like loiing athletic teams, we could always "wait 'till 
. next year. " . " ' , 

But even If we did have good teachers, there were certain limitations I 

t. 

imposed by the very nature of the self-contained class that ma(|* it diffi- 
cult for those teachers to help us a| much as they wanted to. As always, 
s^e pupils 'were more advanced than others. Teachers In self-contained 
classes often find It impossible t;o keep part of the class engaged In 
fruitful learning activities while providing special Instruction td a 
group of pupils who need 1t. All too often, teachers In self-contained 
classes are obliged to assign wheel -spinning activities to the rest of 
the class just so they can give attention to tho^e groufais who need it. 
And the Idea of providing sustained attention to IntTtvldual learners must 
surely seem Illusory to the harassed teacher of a self-contained class. 

Beyond that, teachers In self-contained classes 'are frequently 
obliged not only to deal with subject matter areas where their training 
1s modest, they have to be experts. Very few human beings can acquire 
the requisite expertise to hold forth knowl ^dgeably on the range of subject 
matter dealt with in the primary classroom: reading, writing, arithmetic, 
social studies^music , art, physical education, literature, etc. Teachers 
end up knowing more about some fields than others. But merely because a 
teacher is more facile in^arithmetic , art, and social studies should not 
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deprive that teacheV's pupils from learnljig their fair share about other 
important subjects. Because a teacher is not very skilled in the teaching 
of^reading does not provide an' excuse if children don't learn how'^o read.*' 

The Hawaii 3 on 2 Program 

_ ~r^-; /\ 

It was because the self-contained class carried with it^such built- 
in liabilities that Hawaii educational architects initiated a major 
instructional reform in 1968 to improve the quality of education in the 
primary grades. In bri^f, the Hawaii 3 on 2 Program created a large 
number of team teaching situations when tf)ree teachers were assigned to 
two classes of primary children. Typically, two grades. wer« involved, 
such as K-1 or*2-3, and a larger, more flexible instructional setting was 
provided. Hawaii educators wanted to create tfje kind of instructional 
situation that was described in the second of our two fictitious stories 
by eight -year-olds. The Hawaii 3 on 2 Program was viewed as a vehicle to 
promo'fe^ the kind of educational environment that would make school an 
exciting and happy place, a place.where Hawaii children could learn more 
effectively. 

Since its inception, the Hawaii 3 on 2 Program has commanded consid- 
erable attention from a host of educators. Because a pr^mar^ school reform 
of this magnitude has rarely been seen in America, it was only natural 
that educators elsewhere would be watchijrfg Hawaii's large-scale educational 
experiment with keen interest. 

Fortunately, because of the attention of many Hawaiians, educators 
and legislators in particular, the Hawaii 3 on 2 Progrjam has been subjected 
to a continuing series of evaluations since its inception. The evaluation 
of which^this report is one component has been viewed as an external, 
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de^nttlve evaluation of the Hawaii 3 on 2 Program. It rrtay be_ useful to 
provide a f'l^ remarks about the structure Qf that evaluation and the 
perspective from which this report was written. - 



An Advocate-Adversary Evaluation tlodei 



The evaluation design adopt^ for this appraised of • the Hawaii 3 on 2 



Program was an advocate-adversary model. According to this scheme, two; 
teafis of- special lists are supposed to eqgag'e In anje^sential ly adversarial 
evaluation of the program being appraised, much, as we see ii formal debate^ 
model employed to appraise the merits and demerits of a given proposition. 
There is a pro team and a con team. It is hoped that decision- makers, 
having seen both sides of the case defended with zeal, will be better able 
to render a final judgment. 

Similarly, this evaluation of the Hawaii 3 on 2 Program called for 
the creation of two competing teams, each of v^ich was' composed of four 
evaluation special.ists.-^The four individuals who authored this report 
constituted one of these wo teams. Many months ago we met in Portland^ 
Oregon, to wdrk out details of the evaluation, plan and to decide, by the 
toss of a coin, whether we would be criticizing or supporting the Hawaii 
3 on 2 Program. As the coin landed, we found that we would be the 
Advocate Team, that is, the team advocating the continuance of the Hawaii 
3 on 2 Program quite largely at its present magnitude, although we could 
propose improvements that might make It 'function more effectively. ^ 

At first, it must be confessed, we were a bit disappointed th«Hfc iJ/e 
fended up as the Advocate Team. After all, ft's a bit more fun to knock 
an existing program. few large-scale programs of any kind, created 

as they are by fallible human beings, ^^are unflawed. Whether it's Social 

11 
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Security, the Peace Cofps, or the' HawdH 3 on 2 Program, an energetic - 
opponent Mn always ferret out some deficiencies In such endeavors. Such, 
are th» 1 labll Itles of most largft-scale efforts -to Improve our lot. ^Oh 
yes, 1t. would have been far more fun to cast as the Adversary Te^. 

Our-te«n had looked over the previous evaluations of the Hawaii 

I - 

3 on 2 Program and we knew tha|t there wa? little evidence that childr.en in 
the pr6gram emer^'ged at the end of grade three' with a'Sorrl shingly supe^idr. 
academic achtevement. Furtfier, we knew that the Hawaii 3 on 2. Program 

costs plenty of moniey. And, since money iln' t -tocf plentiful these <lays, • 

"# f ^ \ 

we figured there'd be plenty of people (educators and noneducators alike) 

f 

just dying to get their hands on those 3 on 2 dollars. No, as we mused 
over our fate after that coin flip in Portland, we didn't feel- too 
fortunate. 

^ 

But rules are rules ^ so we. got underway with our efforts to support 
the merits of the Hawaii 3 on 2 Program. The peeper we probed, the more 
comfoVtable we became with our assignment. We ?pent hours "and hours • 
talking to people in Hawaii who were close to the Hawaii 3 on 2 Program. 
We interviewed teachers, parents, administrators, children, legislators, 
interested citizens, department of Education officials, and a host of 
other assorted folks who had views on the program. We observed classes, 
both 3 on 2 and self-contained. We gathered questionnaire data from 
teachers, parents, and administrators. We gave achievement tests of many 
kinds to children in 3 on 2 and self-contained clashes. We administered 
attitude inventories to those youngsters to find out how they felt about 
self-contained and oni2 classes. 

As all'of this' information began to accumulate, we came to the foN 
lowing series of conclusions: 
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1 • Th» Hawaii 3 on -2 Program, while capable of being Imprbvtd, Is 
currently fuilctlonlpq effectively to the educational benefit of 
most ^Mng$ter$ It now serves - 

2 The Hawftll 3 on 2 Program Is functioning effectively because of 

■ . .. * 4 

Its unique Instriictlonal features .' . ^ | 

3. Citizens of Hawaii shoul-d be singularly proud off the Hawaii 
' 3 on 2 Program and strive to strengthen the excellence of this 
high vislbfl Ity 'Educational, reform as an option" for the children 
and teachers of Hawaii . ^ 
The remainder of this report' Is organized around these three major 
propositions. We will present data apd analyses that support each oi^- 
these three Contentions. In view of the enormous amount o| data gathered 
in connection with the current evaluation of the Hawaii 3 on 2 Program, it 
is apparent that many more data-laden arguments coul«d be jjresented . Yet, 
the Advocate Team has attempted to be conscious of the reader's tolerance 
for such evaluSitive data. \^ 

' The interested reader is urged to consult further the complete 
technical report for this evaluation, a report replete with pertinent 
information regarding tfie worth of the Hawaii 3 on 2 Program. In the 
Interest of "conciseness , however, we have chosen to defend the following 
three propositions: (1) the Hawaii 3 on ^Program is working; (2) it is 
working because it possesses ?ome unique instructional advantages; and 
(3) Hawaii should be proud of this effective educational scheme and should 
maintain it as an instructional option for the children and teachers of 
Hawaii. 



13 



The Hdwa11 3 on ^2 Program Is Functioning Eff»ct1Vf1v 

There are inany ways, to tell 1f an edOcatlonal program 1s working. 
Sotne Involve pupils' test scores; some Involve the opinions of those who 
have observed the program; some involve lookinf at the program as H 
operates. The Advocate Team relied on all of these data sources. Having 
reviewed the array of available Information bearing on the effectiveness 
■of the Ijawall 3 on 2 Program. we concluded that It really Is working far ■ . 
better than we Imagined. Later Mn the report we will set forth recommen-. 
dat Ions .for- augffienting Its' effectKeness. Yet, even without such modlfica 
t1(^n's, It Is apparent that the Hawaii 3 on 2 Program constitutes a ma.ior 
educational achievement-ran achievement 1n which the citizens dfj^waii 



should take justifiable pride. 

Before parading out the more formal evaluation data bearing on this 
contention, let's take a close look at some 3 on 2 classes in action. In 
October 1976, members of the Advocate Team spent a final data-gathering 
wee^c jn Hawaii. On an earlier visit we had observed a wide variety of 
3 on 2 and self-contained classrooms. During the October session we 
wanted to look in on some truly outstanding^ on 2 classes. In response 
to our request, curriculum specialists in each Hawaii district identi- 
fied particular 3 on 2 teams they considered to be excellent. We spent a 
good many hours visiting some of these classrooms. The curriculum 
specialists were right. These were truly outstanding instructional situ- 
ations. After spending several days in observing these 3 on 2 teams, we 
were even more convinced that the Advocate Team was arguing the appropriat 
side of the issue. Here is just one example from the kaleidoscope of 
first-rate teaching we saw in October. 
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Team 5, a 3 on 2 team for second and third grade students in an 

filamentary school of the Hortolulu District, Is staffed by three 

experienced elementary teachers, one of whom recently chosji to f 

transfer from a grade sIV self -con tafned classroom In order to work 

with younger chllclren. The pupils- In Team 5 consistfntly score well 

on routinely administered achievement tests. It doesn't take long 

for observers tq note how efficiently the team's teachers are deaTing 

with their instructional tasks. There's ii good deal of smalT" group 

instruction that goes on, with different teachers capitalizing on 

their particular areas ^ expertised , 

When we observed Te\m 5 in October there was a point at which 

two of the team's teachers spll^: most of. the pupils into two groups 

so that the former sixth grada^acher could work with StepTien who 

was making up an assignment/and with a group of five youngsters who 

needed remedial help orr a language arts lesson about which they were 

confused.* Both Stephen and the group of five chil dren . were able to 

get direct and helpful instruction from thegjteacher . 

Becau^'^e she is the team's art specialist, the former sixth grade 

,teaoher was particularly excited g^bout a recently completed project 

that Team 5 youngsters had comf^teted. The children had' completed a 

series of artistic creations for display In the University of Hawaii' 

Art Gallery, Remembering that the 3 on 2 team structure made It 

possible for her and the pupils to carry out this kind o^project 

because her colleag^ie could Instruct those pufrlls who were not f 

heavily Involved in the Art Gallery project, she stated that '*If I 

were in a class by myself, I would either have to give other pupils 

busy work or forget about such special projects." • 
- . * * * . • " 
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Overall Reactions of Principals. Teachgrs^ and- Parents 

During the past year, questionnaires regarding .the Hawaii 3 on 2 
Program were given to a large numb(^, of parents, tec^chers, and principals 
who were associated, in one wa^y or another, with primary education in 
Hawaii. To ensure candor on the' part of the respondents, all three groups 
filled out theif questionnaires anonymously, then submitted tlj^em directly 
by mail to the Northwest Regional Educational Laboratory in Portland, the 
agency supervising the overall evaluation of the> HaWall 3 on 2 Program. 

Questionnaires were returned by 144 principals, 19 of whom had only 
3 on 2 classes in their schools, 14 of whorrt had only self-contained 
classes, and 111 of whom had both 3 on 2 and self-contained classes ill 
their schools. A total of 1,819 teacher questionnaires were analyzed. 
Including 1,173 teacfiers in 3 on 2 teams and 573 teachers in self-contained 
classes. Of 927 parent questionnaires that were analyzed, 516 parents had 
children only in 3 on 2 classes, 225 had children only in self-contained 
classes, and 186 h«d children in both types of classes. 

Although there wer^ many items in each pf the questionnaires given 
to principals, teachers, and parents, there were several questions common 
to all three questionnaires which supplied, in an overall fashion, the 
respondents' appraisal of the Hawaii 3 on 2 Program. Each of the three 
groups was asked what should happen to the Hawaii 3 on 2 Program at the 
kindergarten to third grade levels. Respondents were given four choices, 
namely should the program be (1) expanded, (2) maintained at its present 
level, (3) reduced, or (4) eliminated. In- surveying the responses to this 
pivotal 'questions, we find that principals, teachers, and parents are all 
supportive of the Hawaii 3 on 2 Program . 

Readers who wish to do so are urged to/ consult the tables referred 




to in the Appendix. We will set forthNm of the necessary information 
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1n the text, but some readers will p>*efer to examine-the data In tabular 
form. For the next few paragraphs we'll be describing results contained 

• ' ' ' 

in'Tables 1, 2, and 3 In the Appendix. . ' 

If you review these three tables carefully, you will see that no 

matter wha.t group Is/being polled, whether or^not that group has" ^ special 

f 

Involvement with the 3 on 2 Program, at least 50 percent qIt each group 

wants either to ^pand 3 on 2 or ma'intain it at its present level 

Some of these preferences are quite dramatic. For example, when we 

consider the principals' responses (Table 1), It Is not' too surprising 
that those principals who have only 3 on 2 classes In their schools are 
favorable toward 3 on 2. As we see, over §4 percent of those principals / 
favor expapding or maintaining the program. Furthermore, when we Inspect 
the responses of the 111 principals who have both self-contained and 
3 on 2 classes in their schools, the verdict still sharply favors 3 on 2, 
with almost 70 percent of the principals favoring an expansion or mainten- 
ance of the Hawaii 3 on 2 Program. ^ 

r 

Now the opinion of these 111 principals is truly significant. They'- 
are qualified educational leaders who have daily opportuni ties^«) s^e both 
3 on 2 and self-contained classes in operation. These principals have no 
personal interest in seeing the Hawaii 3 on 2 Prograrn rise or fall--their 
administrative jobs are not on the line. And yet this nonpartisan group 
of knowledgeable educational leaders registers an emphatic vote of 
endorsement for the Hawaii 3 on 2 Program, Ini||pieir view, the Hawaii 
3 on 2 Program is working . 

Let's turn to teacher reactions regarding 3 on 2 (Table 2). When 

the 1,173 teachers currently assigned to 3 on 2 classes were asked, over 

86 percent responded that they wished to maintain or expand the Hawaii 

3 on 2 Program. This indicates that those educators most intimately 

* 
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involved with 3 on 2 are emphatically In suf^rt of the program. But, 
of course, one might argue that 3 on 2 teachers might perceive their job 
security being threatened by this type of evaluation, hence would respond 
positively to such a question"! Therefore, it; is even more impressive 
when >*e turn* to the r'eactions of the 573 self-contained teachers and find 
that over 50 percent of that group also favors expanding or maintaining 
/ the. HaV/ili 3 on 2 Program. _ These self-contained teachers have no axe to 
grind here. If anything, the>might be negatively.,di sposed to 3 on 2 
because they're not involved in the program. And yet, over half of 'those 
teachers of self-contained classes want to maintain or expand 3 on 2. 
Clearly, in the view of Hawaii primary teachers, of both 3' on 2 and 
self-contained^classes, the Hawaii 3 on 2 Program is working . 

".Let's look now, at the pinions of the over 900 parents who completed 
questipnnaires regarding the program (Table 3). Those parents whose 
children were enrolled in only 3 on 2 classes were extremely supportive 
of the Hawaii 3 on 2 Program, with over 76 percent wanting to expand or 
^maintain the program. Parents who had children in both 3 on 2 and self- 
contained classes were also solidly in support of the Hawaii 3 on 2 Program 
With over 63 percent wishing to maintain or expand the program. And, for 
those parents whose children were only in self-contained classes, over 
30 percent' sli 11 want to see the Hawaii 3 on 2 Program expanded or 
maintained. Yes, it is apparent that in the opinions of parents of Hawaii 
primary school childrenr the Hawaii 3 on 2 Program is working . 

We can probe the question of 3 on 2 versus self-contained more deeply 
by trying to get a fix on the relative effectiveness of these two pro- 
grams. Principals who had both 3 on 2 and self-contained classes in their 
schools were asked'to provide judgments comparing the overall progress 
mad^ by children in 3^r\ 2 classes with the progress made by children in^, 
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self-cont«ined classes at the same grade levels. The reactions provided^ 
by theyjlll elementary school principals, knowledgeable regarding both 
3 on 2 and self-contained classes because of their day-to-day contacts 
with both kinds of classes, yields a startling vote of approval for the 
Hawaii 3 on 2 Program. These Hawaii elementary school principal^ think 
that 3 on 2 classes are decisively mftre effective, on all' counts , than 
self-contained classes. 

The information provided by the principals is Summarized in^Jable 4 

r 

** ■ ■ 

in the Appendix where the actual question to which the principals responded 
is provided aloiig with the percentages of principals' responses. A quick 
scanning of Table 4 will reveal that these principals perceived that in, 
• ^very instance more progress was made in 3 orT? classes t han in self- 
contained classes . Some of the comparisons are astonishingly favorable 
toward the Hawaii 3 on 2 Program. 

The comparative information displayed in Table 4 is truly amazing 
and should be studied at length by anyone charged with appraising the 
worth of the Hawaii 3 on 2 Program. First note the consistency of comr* 
parisons favoring 3 on 2, eVen in some of the more routine subject areas 
such as reading and arithemetic, where it is sometimes alleged that teachers 
of self-contained classes can do a better job. In reading, for example, 
31 percent of the principals thought more progress was made in 3 on 2 
classes and only 6 percent thought more progress was made in self-contained 
classes. In reading, as with all^of the other areas, of course, a sub- 
stantial proportion of principals thought that ther6 were no differences' 
in the relative effectiveness of the two programs. But for the 37 percent 
who perceived a difference in the effectiveness of reading instruction, 
84 percent favored 3 on 2 > 
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Notice the dramatic dif'ferences in several of the categories that 
are most consistent with the avowed purposes of the Haw»H 3 on 2 Program. 
For instance, with respect to encouraging children to become more indepen- 
dent learners, 3 on 2 is favored 64 percent to 6 percent. For developing 
a more positive self -concept, 3 on 2 is judged more effective by a 45 
percent to 6 percent margin. In short. Table 4 constitutes an overwhelming 
vote of support for the Hawaii 3 on 2 Program 1n contrast to more tradi- 
tional self-contained instruction. It is impossible to study Table 4's 
results carefully, and not reach the conclusion that the Hawaii 3 on 2 
Program is working . 

Ah Yes, The Test Scores 

In this evaluation, as in many of the previous evaluations of the 
Hawaii 3 on 2 Program, standardized achievement tests have been used as 
an index of the program's effectiveness. This time, as in ttie past, there 
seems to be 1 ittle evidence favoring 3 on 2 youngsters. As is almost 
always the case, results on" standardized achievement tests turn out to 
reveal "no statistically significant differences" between an innovative 
program (in this case, 3 on 2) and the more traditional instructional 
program. But do these results reflect shortcomings in the new programs, 
or do they reflect shortcomings in the kinds of testing devices used? In 
the opinion of .the Advocate Team, arid a growing number of educational 
measurement specialists, standardi zed- achievement tests such as those used 
in the current evaluation are inappropriate for assessing the effects of-^ 
instructional interventions such as the Hawaii 3 on 2 Pro^^'^am. 

Even though, in advance of the standardized achievement tests' beini 
administered, the Advocate Team recognized that there would be no meaning- 
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ful difference between »«lf -contained and 3 on 2 children, it was clear 
that because standardized achievement tests had been used with previous 
ev,aluat1ons of the Hawaii 3 on 2 Program, they should be used in this 
evaluation for consistency and completeness. Yet, in accord with the 
Advocate Team's interpretation of the ground rule that both teams would 
be permitted to secure data of relevance to their case, we agreed to have 
thf tests used. 

Before turning to a brief analysis of why such tests yield a mis- 
leading estimate of program success,, let's look for just a iDoment at the 
test results from this year's evaluation. On two of the many possible 
standardized achievisment tests subscale contrasts involving self-contained 
• versus 3 on 2 children, the seVf-contained children's performance was 
higher. Although the differences were statistical ly significant, they are 
of. little practical significance, being less than two points in one case 
and barely more than two points in a second. Differences of that magni- 
tude, while not statistically significant", can be found favoring 3 on 2 
on other subscales of this year's test results (see the Technical Report, 
Table 12). Given the small size of actual differences, results of the 
achievement testing could hardly be considere<l emphatic support for 
sel f-contained -teaching. 

Similarly, while' the one statistically significant difference on 
;affective (attitudinal*) tests favored the 3 on 2. children, we on the 
Advocate Team can take little solace in such results. On balance, it is, 
a^arent that with respect to test results there are no meaningful differ- 
ences favoring^ either 3 on 2 or self-contained cj asses. 

But, some would say, -"Isn't a no difference resul t damaging to the 
case of the Advocate' Team? After all, the Hawaii 3 on 2 Program costs a 
good deaf of -mon^y, and ,the"test results don't show that it's paying off. 

S J 
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Un't that kind of tvldtnca dtvattating?" To thli m aniwtr with rtal 
conviction— not at all 1 * -i 



Wt've ^rtvlouily damonstrated that in th« vitw of those a^in lit ra- 
tors, teachers, and parents molt Intimately Involved with It, w Hawaii 
X3 jon 2 Pi*oqram Is working . WItV respect to the standardized achievettient 

test results, we have an inst#nee of relying on the wrong kind of measur1n|g 

^ i 
instruments — The consistent failure of the Hawai 1 3 on Z Programy or, for |- 

that matter, almost any large-scale instructional innovation to secure 

I 
I 

better test results, is attributable to deficiencies In the tests , not the 

program. 

Space limitations preclude an exhaustive analysis of why it is that 
standardized achievemeht tests yield s^h inaccurate estimates of a pro- 
gram's success, although such discussions are available elsewhere.' In 
brief, standardized achievement' tests are designed chii^fly to permit 
comparisons to be made among the examinees who ta1(e the test. Distributors 
of such tests want to be able to say that Billy's score of 29 items- correct 
is equivalent to a 47th percentile performance, which means that Billy 
out-performed 47 percent of the group of examinees on which the test was 
nbrmed. Unfortunately, in order to have tests which spread out examinee 
performance widely enough to permit such fine-grained comparisons, the 
individual test items cannot be answered correctly by too large a propor- 
tion of examinees. Consequently, test items th^it are answered correctly 
by^for instance, 80 percent or more of the examinees, are tossed out of 
the test. But these very items, the items on which youngsters perform 
well, often are based on the content that teachers thought important enough 
to stress. As a result, when standardized achievement tests are revised 
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(as they perlocHcally are) thert Is a tendency to jettison the very Items 
covering the most Important content. What we end up with Is a test 
covering less Important topics, an achievement test that functions more 

like an Intelligence test. Such tests are Instructional ly Insensitive. 

f 

When you couple this technical deficiency with the fact that such 
tests' are often badly mismatched with local currlcular emphases, for 
example, the emphases of Hawaii 1 schools, you can see that standardized 
test results often provide a geni>1nely erroneous picture of an Instruc- 
tional program's quality. 

In a May 1975 review^ of the merits of standardised achievement 
tests, a group of Hawaii educators reached the conclusion that such tests 
poss'essed serious liabilities for educational evaluation In Hawaii. 

' i 

We have to add one more point to be ^considered as we evaluate the 
Hawaii 3 on 2 Program, namely, have 3 on 2 teachers ever attempted in a 
serious* fashion to have their students excel on particular types of 
achlev^nt tests? The answer is dec1s>/ely NO. That may be what citi- 
zens of Hawaii want their primary education program to do*. But let's \\ot 
judge a program adversely on the basis of tests that, in the first blace, 
are technically inappropriate for that purpose and, 1n the seconds/place, 
have not been high priority instructional targets for Hawaii's teachers. 

The Affective Tests 

MemU^s^f t\^e Advocate Team were reall^ anxious to administer a 
number of Vfective measures to the 3 on 2 and self-contained yoti'ngsters , 
sinc^ we were willing to concede that the standardized achievement tests 
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b«1ng used, for tht afor«mentlQned reasons, would provide essentially 
meaningless data. Yet, as is well recognized by measurement experts, the 
development of genuinely valid and sensitive affective assessment devices 
is a task of major magnitude, a task which exceeded the resources available 
in the current project. Instead, we had to adopt some existing affective 
instruments in the hope that they would pick up at least gross affective 
differences. As it turned out, there was precious little difference in 
students' scdres irrespective of whether they were in self-contained or 
3 on 2 classes. Not surprisingly, therefore,' the affective results 
reflected no substantial differences between the measu'^d attitudes of j 
children in 3 on 2 and self-contained classes.-. ^ 

Improving the Hawaii 3 on 2 Program 

Any educational program, whether innovative or ongoing, can be 
improved. Members of the Advocate Team instantly concede not only that 
the Hawaii Department of Education's coordination of the 3 on 2 program 
has not been as effective as it might have been, but also that some 3 on 2 * 
"classes are not as effective aS they should be. But such pockets of 
ineffectiveness can be identified and remedied, particularly -by capitaliz- 
ing on some of the very assessment schemes employed in the current evalua- 
tion of the Hawaii 3 on 2 Program. We propose that an outcome-focused 
quality control scheme be initiated without delay whereby the qual'ity of 
3 pn 2 classes be monitored with respect to papil performance on suitable 
asures of achievement and affect. 

By continuously, monitoring the progress of 3 on 2 teams according to 
the results they produce , assistance could be provided to those teams that 
need it. '"The Hawaii 3 on 2 Program has been operating for eight years now. 
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During this time a number of really, superlative 3 on 2 teachers have 
emerged. A small cadre (probably with rotating membership) of these 
excellent 3 on 2 teacher^ could constitute a task force whose Job 1t 
would be to aid those 3 on 2 teams where pupil ^ failed to make satisfac- 
tory progress on Appropriate a<i<il«vemenit tests or whose performance on 
affective measures Indicated, for example, that their attitudes toward 
scho^ or their self-esteem was In need of attention. There Is no need 
to go to the ma1nla;»d to ship In visiting experts who can rectify such 
problems* By this time the Hawaii 3 on 2 Program has created abundant 
local expertise in how to make 3 on 2^ classes function to the benefit of 
children. There are numerous 3 on 2 teachers, principals, and curriculum 
specialists who really know their stuff. Let's use them wlij^y. 

Getting mot^e specific, this very suirmer a task force of effective 
3 00 2 teachers could be organized to develop a .set of experienced-based 
guidelines fi^j;. organizing and 6perating 3 on 2 classrooms. Previous 
Department of Education support materials have often lacked the practical 
"how- to-do-it" suggestions which effective 3 on 2 teachers might share. 
For example, these guidelines cogld offer suggestions for dealing with 
shy children, poor readers, unruly youngsters, etc. in a 3 on 2 setting . 
Very few commercially published treatments of instructional practice have 
t)een written with a team-teaching organization in mind. Creation of a 
particularized guidebook for the Hawaii, 3 on 2 program could be invaluabl 

Unlike the traditional standardized achievement test which provides 
almost no idea of the types of pupil behaviors it actually assesses, a 
newer form of test (known as criterion-referenced measures) does supply 
an explicit picture of what's being measured. In the current evaluation 




of tht Hawaii 3 on 2 Programt cri ttrion-reftrtneeKl tests ware used as 
erssessment devices for th^ first time. But even before, the test results 
were in, members of the Advocate Team were convinced there would be no 
differences favoring 3 on 2 children. Adopting criterion-referenced test^ 
as a belated a^ssessment device is like judging a person's work after it's 
completed by applying previously unannounced criteria. Post facto targets 
are no targets at all. * 

Predictably enough, results of €he criterion-referenced tests used " 
in the present evaluation revealed no meaningful differences between 
children taught in 3 on 2 versus self-contained classrooms. But while 
the Advocate Team strongly eqdorses the use of criterion-referenced 
measles to evaluate programs such as 3 on 2, we cQnte>id that failure to 
secure differences in favor of 3 on 2 children was a function of the 
after-the-fact fashion in which these criterion-referenced tests were jjsed. 
y Clearly explicated criterion-referenced tests covering highly 

significant kinds of skills that Hawaii youngsters should master, could 
/ j>nd shou-ld constitute the core component of a continuing system of per- 
tprmance-oriented evaluation for the Hawaii 3 on 2 Program. Similarly, 
the \se of affective assesment devices which dealt with the important 
attitudinal goals of 3 on 2''could be blended wfth the criterion-referenced 
tests to yield an excellent idea of which 3 on 2 teams were in need of 
assistance. 

Without goipg into inordinate detail, the Department of Education 

•* ' ' ' 

could, in consultation with a wide range of Hawaii's teachers and citizens, 

%\ 

identify a small number of minimal competencies in reading and mathematics. 
Criterion-referenced tests could be develo^ied to assess these competencies, 
with accompanying descriptions of the competencies being distributed to 
Hawaii's primary teachers. By periodically assessing the extent to which 
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children were achieving these wel 1 -described sV^XU^^ylV would be possible 
to identify 3 on 2 teams which were in need of supervisorial assistance. 
In the same way, measures of affect could be^^4>«jd3dical ly administered 
to provide indices of the relative success of 3 on 2 t^ams in achieving 
key affective goals. The stcess in such a monitoring system would be on 
the results of Instruction as evidenced in pupil behavior. 

Clearly, the ingredients of such a progress-monitoring system would 
have to be worked out so that it would not be cumbersome, y%t would pro- 
vide the kinds of information needed. Members olf^the Advocaten Team 
believe that the Hawaii 3 on 2 Proqram->is working . We want to see it ^ 
work even" better. . . 

Unique Instructional Attributes 

We have seen that, from several perspectives, the Hawaii 3 on 2 
Program^appears to be functioning effectively. Why is this so? What is 
it that leads so many people to assert Jmat this program is worth main- 
taining or even expanding? 

Well, in the view of the Advocate Team, that's a fairly simple ques- 
tion to answerT^The fact is that the Hawaii 3 on 2 Program incorporates 
some instructional advantages that clearly cannot exist in a conventional 
self-contained class. A number of these have been alluded to earlier in 
various ways. Let's spell them out, although briefly, so they don't g6" 
unnoticed. Thankfully, these strengths of the Hawaii 3 on 2 Program have 
not gone unnoticed by peeple familiar with the program, as we'll point out 
in a moment. 

The oft-cited but nonetheless powerful advantages of a 3 on 2 class 
are listed below. Incidentally, the six advantages presented below were 
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not pluektd from any Department of Education document treating the merits - 
of 3 on 2. Rather, they are drawn from the Advocate Team's observations, 

♦ 

interviews, and questionnaire Interactions with hundreds of rfawall . . 
primary teachers. 

1 . Teachers can more flexibly organize students so that they can 
be taught, as Indlvldugli* and as groups, according to the 
cMJ^dr^n' s , needs . j 

2. The team can capitalize on Its members' particular Instructional 
skills, so that teachers can Instruct In their areas of strength , 
for example, (tiuslc, science, or art . 

3. The (^leglal Interaction among 3 on 2 teachers elevates their 
t^rofesslonal standards and strengthens their Instructional 
skills . 

4. Children have a better chance ^f finding an adult to whom they 
* can relate, both personally and instructionally . 

5. If a teacher is absent, the team's instructional program can go 
on largely undisturbed because two team members are present . 

6. Younger children dn learn from the older children in theiV 

. two-grade Glasses . 
a ^ 

While there are other advantages associated, wi th the team-teaching 
organizational structure of the Hawaii 3 on 2 Program, these six Instruc- 
tional dividends are peculiar to a 3 on 2 setup. They cannot be present 
In a single-grade self-contained classroom. Three teachers and 60 or so 
children simply have it better than one teacher and 25 children. The 
flexibility potentials of a 3 on 2 class dramatically outdistance those 
available to even the most energetic and devoted teacher in a self- 
contained class. 
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Not only doti tht Hawaii 3 on 2 .Program rtprastnt a conctptually 
sound Ijistructlonal schtm«*» It Is actually working. For txamplt, In 
Octotmr 1976 as part of the current evaluation, a University of Minnesota 
specialist In Individualized Instruction. Michael Patton» observed 
numerous 3 on 2 classes. He concluded as follows: "Based on my experience 
1n other programs of this k1nd» i.e.. team teaching programs on the 
mainland. I thought that the 3 on 2 classrooms exhibited a higher than 
usual degree of real teaming. Team teaching has not been'^rery highly 
implemented on the mainland, despite rhetoric to the contrary."^ 

Parents, teachers, and administrators are also cognizant of the 
unique advantages of the 3 on 2 organizational structure. In their 
responses to questionnaire items, for example, large proportions of 
parents (irrespective of whether their children were in 3 on 2 ^classes, 
self-contained classes, or both) thought that the Hawaii 3 on 2 Program's 
major strengths were that (1) teachers worked together as a team and 
shared their special talents (67 percljnt of the parents identified this 
as a strength), (-2) childrjen learn from older and younger children (55 
percent), (3) children have a greater variety of materials and adults to 
work with (54 percent), and (4) it allows teachers to group children so 
they can learn better (44 percent). While the parents cited a number of 
other advantages of the 3 on 2 system (information is available U\ the 
complete Technical Report of this evaluation study), only a smalll propor- 
tion of parents cited any weaknesses associated with the Hawaii(^on 2 
Program (see Technical Report, Table H-3.7). 
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similarly, teachers saw a number of advantages Inherent 1n the 3 on 2 
structure./ For example, over 97 percent of the 3 on 2 teachers registered 
agreement with the assertion that "chi Idren- can find at least one of the 
three adults with whom they can get along." And even 79 percent of the 
self-contained teachers agreed with tfie same assertion. Both 3 on 2 \ 
teachers (92 percent) and self-contained teachers (62 percent) agreed that 
the 3 on 2 program presented children with a greater variety of. mater ialJ 
and adults to work with than in a self-contained classroom. Both 3 on 2 
teachers (91 percent) and self-contained teachers (51 percent) also 
recognized that when a teacher is absent, the student's Instructional 
program is not interrupted. In sum, whether teachers are in a 3 on 2 or 
self-contained class, they clearly see special advantages assQcia^ted with 
the 3 on 2 organizational structure. / 

, Finally, principals clearly recognize that the Hawaii i on 2 Program 
carries with it some special advantages. About 60 percent of those 
principals who have both 3 on 2 and self-contained classes in their 
schools, for instance, lj)elieve that children in 3 on 2 classes receive 
more individual attention from a teacher than in self-contained classrooms* 
Aboutj90 percent of those principal swi th only 3 on 2 classrooms in their 
schools agreed. Principals also decisively agree (well over 90 percent) 
that children in a 3 on 2 class learn from each other. They also agree 
(over 85 percent) that having three teachers in 3 on 2 allows pupils to 
find at least one adult with whom they can work. The principals believe 
that teachers work together as a team and share their special talents 
(90 percent), and that children have a greater variety of materials and 
adults to work with them in a 3 on 2 class (well over 80 percent). While 
there are many other advantages to the Hawaii 3 on 2 Program that princi- 
pals recoV^^ze', this brief listing of some of their questionnaire responses 
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should mtkt It appartnt thtt thtit txptrltnctd •duc«t1on«l Iwdtrs 
rtcognixt tht lingular advantagts of th« Hawaii 3 on 2 Progc*m ($t« • 
i;j8Chn1cal Rtpprt, Tablt H-4.7). • 

In arstncf, tht Advocatt Team belltvts that thtrt ar« comptlllng 
organizational advantagt i , to a 3 on 2 approach lo that If ont wtrt tO 
take three highly competent teachers and place them In self -contained 
classes for year one. then In a 3 on 2 situation for year two. their 
instruction In the 3 on 2 setting would be far more effective. It would 
be "Var more effective because as teachers In self-contained classes they 
would be deprived of the many unique advantages of the Hawaii 3 on 2 
Program. These advantages are worth retaining. 

Preserving the Hawaii 3 on 2 Program as an Option 

~ Careful Inspection of the Technical Report's detailed information 
will reveal , as would common sense, that not all. 3 on 2 teams are as 
successful as one would like. . Just as there are weak and strong teacher 
of self-contained classes, there are weak and strong 3 on 2 teams. Ear- 
liejr in our report, the Advocate Team described the main feature^, of a 
continuing monitoring system designed to strengthen the less effective 
3 on 2 teams. But no sensible person can dispute the fact that there are 
many,, many teams in the Hawaii 3 on 2 Program that are currently provldini 
high quality instruction for primary children. 

There are also teachers in sel f-conta-ined classes who are providing 
exciting and effective instruction for prjmary children. As matters 
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currently stand, Hawaii schools off»r both , options to most youngsters. 
We believe that this situation must . continue . 

There are, Withowt question, profound differences in the learning, 
•styles of children. A teaching technique that may work well for Fred can 
fall flat for Florence. Similarly, '3 on 2 may not be suitable for every 
child in grades K-3. For example, about the only limitation that a sub- 
stantial number of questionnaire respondents thought might exist in the 
Hawaii 3 on 2 Program was that a shy chi^d mi^ht get lost in the large 
group. Discounting for the moment the fact that shy children often get 
lost in conventional self-contained classes well, let's concede the 
possibinty. Well, if both 3 on 2 and self-contained classes are retained 
as options for youngsters in Hawaii, we arrive at a classic triumph of 
simultaneous cake-having and cake-eating. ^ 

There are differences in kids. There are differences between 3 on 2 
arid self-contained classes. The numerous parents, teachers, and principals^ 
who supplied questionnaire data recognized both of these points when they 
offered resounding support for the contention that the Hawaii 3 on 2 
Program should be preserved as a choice for those who want it. This 
information is set forth in Table 5 in the Appendix. When responses are 
presented to the question "How important do you feel it is to keep 3 on 2. 
as an option for tijose schools, students, and teachers who want it?", no 
matter what group responded, substantial numbers of the respondents indi- t 
cated that they wanted to retain 3 on 2 as an option for those who wished^ 
it. For example, of the 111 principal s who supervised both 3 on 2 and 
self-contained classes, 66 percent believed it was very important as an 
option. All groups, as an inspection of Table 5 will reveal, registered 
Strong support for the importance of keeping 3 on 2 as an option. 
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There was » of course strong support a Isof for maintaining self- 
contained classes as an option In every school. This Is precisely what 
the Advocate Team 1$ contending, namely, that tx)th 3 on 2 and self- 
contained classes be available to the pupT^s and parents of Hawaii. 
Parents should not be forced to place their children In an Instructional 
setting they believe will not benefit that child. Yet, as we have seen, 
the majority opinion Is clearly that the Hawaii 3 or^ 2 Program In mcS^t 
cases provides an exemplary Instructional opportunity for primary grade 
children. Parents should not be deprived of the opportunity to place 
their children In such a rich educational environment. 

w 

Besides preserving 3 on 2 classes as an option for tft children of 
Hawaii, It should |e recognized tha,t Hawaiian education will benefit by 
maintaining 3 on 2 as an option for the teachers of Hawaii. Teachers, 
just like youngsters, differ. Some teachers who might shrivel in the 
isolation of a self-contained classroom, really blossom In the collegial 
stimulation of a 3 or\|2 class. Other teachers really work most effectively 
in the autonomous setifing of a self-contained class. For the good of 
Hawaii education, both instructional settings must be preserved in order 
to capitalize on particular teachers' strengths. 

A Matter of Pride 

The Hawaii 3 on 2 Program has been in existence for a number of years 
now. It has attracted both national and international attention, not only 
because of its substantial magnitude but also^ecause of the forward- 
looking instructional features it incorporates. Will the citizens of 
Hawaji be satisfied at this point to discard this highly visible educa- 

> 

tional innovation? 



i$ more appropjp.iate to conceive of the Hawaii 3 on ? Program as a 
creative and potentially eff»ect1ve educational Intervention that has at 
this moment reached a plateau. Whether the people of Hawaii capitalize 
onVthls situation to strengthen an already effective 1n;itruct1onal inter- 
veiijAon or waste their eight-year, mult1-m1ll 1dn dollar Investment 1n 
educat1oi(ii^al reform remains to be seen; 

When members of the Advocate Team were originally assigned the task 
of defending the Hawaii 3 on 2 Program, wondered how 1t was that 1f the 
program Is sd^defectlve, 1t has survived for so many years. The answer to 
that question, as we discovered dur,1ng our countless Interviews and 
observations, 1's^stralghtforward. - The Hawaii 3 on 2 Program has survived 
because It represents an Instructional ly sound Idea. It 1s an idea too 
precious to eliminate. 

We have attempted to demonstrate, hopefully to the reader's tfatisfac- 
tion, that the following jjropositions are accurate. 

1 . Tbe Hawaii 3 on 2 Program, while capable of being improved, is 
currently functioning effectively to the educational benefit of 
most. youngsters it now serves . 

2. the Hawaii 3 on 2 Program is functioning effectively because of 
its unltque instructional features . 

3. Citizens of Hawaii should be singularly proud of the Hawaii 

3 on., 2 Program and stri ve/to^strenqthen the excel lenc'e of this 
hiqh^wiSibility educational reform as an option for the children 
and teachers of Hawaii . ^ 
To the extent that these contentions ar4 valid, the educational 
decision makers of Hawaii should conclude that the Hawaii 3 on 2 Program 
is an educational endeavor worthy of their continuing support. 
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We recommend, therefore, that the Hawaii ^ on 2 Program be maintained 
at its present level as an instructional option f'or Hawaii primary 
education. We recommend, further, that creative efforts to improve the 
quality of the Hawaii 3 on 2 Program be initiated instantly . To eliminate 
or seriously reduce the magnitude of the Hawaii 3 on 2 Program would 
create serious negative consequences^-negative consequences that would be 
experienced by the children of Hawaii during their crucial, formative 
years. While the costs of the Hawaii 3 on 2 Program are substantial, the 
adverse effects of abandoning this effective instructional program ar^ 
too severe. The Hawaii 3 on 2 Program must be maintained. 
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TABLE 1 

Recommtndtd Action for tht Hawill 3 on 2 Program by 120 Principals 





^'rlnclpaU with only 


PrlndpaU with 3 on 2 and 


Rtcoirmtndtd 


3 on 2 clastts 


stlf>conta1ntd clatstt 




(N - 19) 


(N • 111) 


Expand 


27. 8X 


15. U 


Maintain 


66. 7t 


54.71; 


Reduct 


5.6X 


11. 3t 


El Imlnate 


V 


18. 9t 









t 



TABLE 2 

Reconwended Action for th« Hawaii 3 on 2 Program by 1,749 Ttachers 





3 on 2 


Self-Contained 


Recommended 


Teachers 




Teachers 


Action 


(N - 1.175) 




(N • 574) 


Expand 


25. 6X 




8.3% 


Maintain 


60.8% 




42.2% 


Reduce 


9.U 




20.1% 


El imlnate 


4.5% 




29.3% 


-J 


TABLE 


3 




Recommended Action for the Hawaii 


3 on 2' Program by 905 Parents 




Parents of 


Parents of 


Parents of Both 




3 on 2 


Self-Contained 


3 on 2 and Self- 


Recommended 


Children 


Children 


Contained Children 


Action 


(N ■ 503) 


(N ■ 222) 


(N - 180) 


Expand 


27.0% 


11.7% 


20.1% 


Maintain 


49.5% 


38.6% 


43.1% 


Reduce 


13.4% 


15.2% 


18.4% 


El imlnate 


10.2% 


34.5% 


10.4% 
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TABLE 4 



Rtlatlvt Efftctlvtntii of Hawill 3 on 2 Progrtin C1a<ttt 
and Stlf-Contalntd Clastat as Judgtd by 111 Eltmtntary Principals 

f ....... ... 

(Tht qutstlon givtn to principals haylna both stlf-contalntd and 3 on 2 
classts la thtir schools: "Btlow Is a list of 14 artas of conttnt, 
knowltdgt and ptrsonat dtvtlopnwnt In which chlldrtn can avidtnct ^growth. 
For tacn of tht 14 artas, pi tast compart your ptrctptlon of tht ovtrall 
progrtss mad# this ytar by chlldrtn In 3 on 2 classts and thost at tht 
same, gradt levels In self-contained classes.") 



Area 


Mort Progrtss 

In 3 on 2 


Mort Progrtss In 
Stif-contamtd 
Clasttt 


Reading 


31.3% 


6.3% 


Becoming a more Independent learner 


63.8% 


6.4% 


Arithmetic 


17.7% 


8.3% 


Taking an interest in school 


30.5% 


4^% 


Science 


20.2% 


2.1% 


Exercising self-control 


37,2% 


16.0% 


Music 


21 .U 


5.3% 


Communicating with adults 


44.7% 


6.4% 


Art 


22,1% ^ 


3.2% 


Getting along with othtir children 


51 . 6% 


^ . 4.2% 


Physical education - 


"25.0% 


3.9% 


/ 

Using time wisely ^ 


37.2% 


12.8% 


Social studies 


22.3% 


2.1% 


Developing a more positive 
self-^OQcept 


45.3% 


6.3% 
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TABLE.8 

■ f 

Ptrctptlon of Importtncf of fttUlrllng th« 
Hawaii 3 on 2 program at an Option 







1 D.^.. 




■ " • 1 








Principal 1 of both 
3 t)n i and itlf- 
• contalntd clatfti 


m 


66.4 


23.6 


10.0;^ 


Principal! of 3 on 2 ' 
ciasstt 


19 


94.7 


5.3 


mm 


Ttachtrs of 3 on 2 
claiftf 


i.on 

• 


82.3 


14.5 


3.2 


Ttachari of ttif- 
contaTntd classts 


469 


43.1 


34.3 


22.6 


Partnts of 3 on 2 
chlldrtn 


447 


54.6 


37.2 


8.2 

• 


Parents of stlf- 
contalntd children 


207 


38.2 


38.2 J 


23.7 


Parents of both 3 on 2 
and self-contained 
chUdrety 


179 


45.8 


37.4 


16.8 
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i : 

Tht dtsign of this tvaluatlori study rtqulrtd that ont taam of 
tvaluators Idtntlfy strtngths and anothtr ttam Idtnttfy dtflcltnclts of 
tht program. Thus, this Rtport of the Adversary Tttw 1$ only ont part 
of tht full tvaluatlon rtport. It Is a rtport of dtflcltnclts. Taktn by 
Itself, this Report does not represent an overall ptrsptctlvt of strtngths 
and weaknesses. The points advanced by the Adversary Team, howtvtr, art 
supported by data and by logic. 

* 
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Th« Hawaii 3 on 2 Program was evaluated by a team of ten ©valuators 
assembled by the Northwest Regional Educational Laboratory. The study 
was conducted through the use of an advocate-adversary ev^atlon design. 
The full *ten-member team made' decisions on data to be collected and ^he 
manner in which the data were to be analyzed. Then, the team was divided 
into^two teams of four members each; and two additional members served 
as co-directors of the overall evaluation study. By random assignment, 
one t^am (therfadvocate team) assumed responsibility for Identifying 
strengths of the program. The other team (the adversary team) assumed 
responsibility for identifying weaknesses of the prograin. Both teams 
used the same bank of data, which is reported in a separate Technical 
Report J 

The 3 on 2 Program is a combination of team_ teaching and open 
education in the primary grades, kindergarten through grade three. A 
3 on 2 classroom is organized with three teachers and approximately 
sixty (60).*pupils who represent two vertical grade^ either kindergarten 

and grade one, grade one and grade two, or grade two and* grade three. 

Fifty-four percent (54%) of the primary chil'dren in Hawaii public . 
schools are enrolled in 3 on 2 classes;' forty-two percent (42%) are 
enrolled in self-contained classrooms; and four percent (4%) are enrolled 
in classrooms with a modification of 3 on 2 (typically, two teachers 
and a teacher's aide). 

A matter which will be discussed more extensively in another section 
of the report, but-A^iich is pertinent here, is a pervasive problem of 
ambiguity of statements of program objectives for 3 on 2. There are, 
however, statements of specific learning outcomes for all children 
whetheV they are placed in 3 on 2 or self-contained classrooms. These 
statements, listed below, were enunciated in a number of 3 on 2 Program 
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documents over the years and werejncluded in the first published 

description of 3 on 2 in 

To acquire basic academic .learnings. 

To increasingly develop $elf-di rection (subsequently 
restated, "to develop autonomy in learning"). 

•To dev^fop^a more realistic and positive self-concept. 

To establish satisfying interpersonal relationships. 

The relationship of -3 on 2 to- these-statements-was-ampl~ified-1n a 

4 

1974 long-range planning document by DOE with the following assertion: 
"The assumption is that students' in 3 on 2 wfll exhibit greater gain 
(emphasis added) than students in self-contained classes in attaining the 
program objectives." Thus, the team has collected data in relation to 
these objectives and ha§ searched for evidence of "greater gaihs" than 
that achieved by students in self-contained^ classrooms. 

Data which were gathered included tist information (cognitive and 
affective) from students; data from classroom observations; information 
gathered by interviews with officials of the executive and legislative 
branches of State government. Board of Education members. Department of 
Education leaders, teachers, parents, principals, district school leaders, 
students and other interested citizens; questionnaire data collected in 
the Spring of 1976 from primary (kindergarten through grade three) ^ 
teachers, elementary school principals, and a random sample of parents of 
primary- level students; addi tionaV questionnaire data Collected in the 
Fall of 1976, from a random sample of primary teachers who were invited to 
complete a "Teacher Views of Classroom Instruction" questionnaire; and 
qliestionnaire data from a random sample of fourth grade teachers who were 
invited to answer questions designed to ascertain if therejv^re observed 
differences between students in the fourth grade who came from 



stl f-cpnta1_nid cl iss^^ and froin\ 3 on 2 class rooms . In add1 11 on » 
nuiMroui documtnts dtscr1pt1vt of 3 on 2 objtctlvts wtre rtvlewtd; a 
cost $tudy was dona; and a taachar-abtantaa study was dont. Furtharmora, 
to broadan tha basa of Infonnation, six opan haarlngs vyara hald in tha 
Spring of 1976 to which all ^Intarastad citizans wara invitad, 

• Ona part of this evaluation which comparad a random tampla of ' 
3 on 2 classrooms with a randow sample of salf-containtd classrooms is 
citad in tha following sections of this Report which daal with student 
achievamant. Socioeconomic status of the students, measures of their 
abil1ty^and enrollment In classrooms using Hawaii English Program (H^P) 
materials, are Independent variables in this evaluati^study. Other 
controls were exercised through randomization. (See the Technical Report 
for details of the study design and data analyses.) 

- 3 on 2 Deficiencies in Producing 4 
Greater Gains in Student Achievement 

This is the Report of th'e Adversary Team, a report of deficiencies 
in the 3 on 2 classroom organizational pattern. 

r 

Three-on-Two was a beautiful dream in the Spring and Summer of 1968. 
In describing some aspects of the dream, one high-ranking school official 
asked: "Why separate the grades artificially? Why keep cognitive 
learnings away from Kindergarten children? Why not provide kids with 
options in relating to their teacher'(s)?" All are excellent questions! 

In real life, however, the dream has not come true, as can be seen 
from responses to some very fundamctntal questions of 3 on 2. 
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student Cognitive Achievement \ 

Perhaps the most fundamental questions posed by the evaluation team 
had to do with student achievement In the basic skill areas of reading 
and mathematics. 

Question 1 ; Do 3 on 2 students achieve more in reading than students 
in self-contained classrooms? 
No! 



In the Spring of 1976, the Comprehensive Tests of Basic SkiTfs TCTBS) 

Level 1, Form S, was administered to a random sample of third grade 

students who had spent at least three years in 3 on 2 classrooms and a 

random sample of third grade students who had spent at least three years 

in self-contained classrooms. Ther/were significant differences between 

the two groups on the reading vocabulary and on the reading comprehension 

subtests. Self-contained students scored higher 3 on 2 students on 
5 

both measures. 

In addition to the CTBS, a standardized norm referenced test, another 
test, a criterion referenced test (CRT) published by the Instructional 
Objectives Exchange (lOX), was administered in the Fall of 1976 to two 
groups of fourt)i graders randomly selected respectively from among the 

\ 

3 on 2 and self-contained students tested in the Spring. These students 
were tested on the following six reading areas: 

1. Selecting examples and synonyms to match contextual definitions. 
Objective tested: Given two sentences, one of which uses an 

unfamiliar word, the student will select a synonym or example of the class 

> 

of things or qualities described by the unfamiliar word. 

2. Identifying the most general statement. " ^ 
Objective tested: Given three statements, the student will 

select the most genera-i statement. 
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3. Undtrstanding txplici tly-stattd conttnt. 

Objtctivt tttttd: Givtn a britf passage writttn in th« actlvt 
volctt, tht student tan correctly complete sentences ustng literal detail 
found within the passage, 

4. Simplk logical reasoning. 
Objective\tested: The student can identify a specific fact 

which my be logically inferred from another given fact. 

5. / Making definitions from factual informatjon. 

Objective tested: After reading short paragraph containing 
factual information, the student can identify the most logical answer to 
a question. 

6. Identifying possible outcomes. 

'Objective tested: Given four outcomes, the student can select 
the two which are consistent with the situations or^ facts presented in a 
short paragraph. 

There were no significant differences favoring the 3, on 2 over 

' ^ "6 7 

self-contained classroom groups on any of the CRT reading areas. * 

Thus, student achievement in reading was evaluated through the two 
most prevalent methods of testingr-standardi zed norm referenced tests and 
^iteri on .referenced tests; and, neither method of testing yielded 
significant differences favoring the students In 3 on 2 over thgse in 
self-contained classrooms in their reading achievement. 

Question 2 : Do 3 on' 2 students achieve moi^e in mathematics than 
students in self-contained classrooms? 

No ! 

As in reading, there were no significant differences favoring 3 on 2 
students on two CTB5 mathematics^ scores--mathematics computation and 
mathematics concepts and applications. |he four fundamental mathematical 
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optratlons of addition, subtraction, multiplication and division wtre 
t«sUd. Mathtmatlcs concepts miiasurtd included th(t students' ability to 
convert toncepts expressed In one numerical, verbal, or graphic form to 
another form, anj;^ to comprehend numerical concepts and their inter- 

relationships; and the mathematics applications measiired the students* 

" 8 
ability to select and carry out problem-solving operations. 

Furthermore,' there were no significant differences between the two 

Oups of fourth graders on CRT measures of the following six areas of 

mathematics: 

1. Multiplication with one-digit numerals. 

Objective tested: The student will be able to solve a 
multiplication problem involving two, one-digit numerals. 

2. Subtraction with two-digit numerals. 

Objective tested: The student will be able^^ to solve a ^ 
subtraction problem with a non-negative solution not requiring regrouping, 
involving a two-digit numeral and a^one-digit or two-digit numeral. 

3. Fractional numerals' and number words. 

Objective tested: Given a proper fraction, the student will 
select the verbal expression that references the fraction. 
^. Ordering cardinal numbers. 

Objective tested: Given a list of from three to five cardinal 
numbers, the student will select the rearrangement of these numbers which 
gives the numbers in the ascending order of their values. 

5. Division: one-digit divisor, three-digit dividend. 

Objective tested: The student will be able to solve a division 
problem involving a three-digit dividend and a one-liigit divisor. 



56 

4 



57 



6. A^ltlon with two-ill^lt numtrili. 

Objitptlvt tttttd: Tht student Mill bt lb If to tolvt i word 
probltm whole solution rtqulrti addition with ont-d1g1t or two-digit 
numerals and rtgrouplng. * 

Thus, tht two most pravaltnt mtthods of tts ting, tht stand«rd1zt>l 
nortn rtftrtnctd ttst and tht crittrlon rtftrtnctd ttst, falltd to Idtntify 
significant difftrtncts favoring tht studtnts In 3 on Z ovtr thost In 



stif-contalntd classrooms in tithtr thtir rtading or mathtmatlcs 
achiavtmtnt. 

Question 3 : Are there, perhaps, some residual achievement gains of 
basic reading and mathematics skills by students who are in 3 on 2 
classrooms over students in self-contained classrooms during the primary 
grades that can be identified, later in the students* elementary school 
studies? 

No! 

A random sample of sixth grade students was -tested in the Fall of 
1976 in conjunction with the statewide achievement te'jtting program. For 
this sample of students, data were not available to control for the use 
of Hawaii English Program* materials during the primary grades. This 
differs from the third and fourth grade testing where the HEP variable 
was treated as an independent factor. Thus, the only independent 
variables for the sixth grade testing were measures of ability and 
socio-economic status of the students. The randomization process was 
applied as a control for HEP. 

The scores on the Stanford Achievement Tests (SAT) of reading, y 
vocabulary, reading comprehension, mathematics concepts and applications, 
and mathematics computations were not sigificantly different between 
students who had, during the primary grades, spent at least three years 
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1n 3 on 2 clissr^omt and studtnts who had ip«nt at Itait thret >«ars In 
ftlf-contilntd classrooms 

In summary , .studtnt achlivtrntnt In the basic skills of reading and 
mathematics were no greater for students who had spent at least three of 
their school years kindergarten through grad^ three In 3 on 2 classrooms 
than for students who had spent at least three of those years In 
self-contained classrooms. The results were the same regardless Of the 
test form— CTBS, CRT, or SAT. Moreover, the results were the same, 
regardless of the point In time when the students were tested— third 
grade, fourth grade, or sixth grade. 

Student Affective Achievement— Attitudes and Feelings 

There are, of course, Important objectives of schooling In addition 
to cognitive learning. Among other Important objectives are those 
.classified as affective. The evaluation team testecfa number of such 
variables, and sought answers to additional questions about possible 
differences between students In 3 on 2 and those In self-contained " 
classrooms. 

Question 1 : Do 3 on 2 students have a more favorable perception of 
themsel ves--1n general, 1n relations with peers, and In school situations 
than students In self-contained classrooms? 

No! 

The Student Attitude Inventory designed by the evaluation team was a 
compilation of well-known attitude scales published by the Instructional 
Objectives Exchange. In the Spring of 1976, the Instrument was 
administered to the same sample of third grade students described earlier 
who were administered the CTBS reading and mathematics scales. The study 
design included socio-economic status and use of Hawaii English' Program 
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imttrlals as Indtptndtnt factors as was tht cast for tht CTB$ 
cognltlvt ttsts. 

Thrta subscalts of tht Studtnt AttUudt Invtntory mtasurtd tht 
studtnts' appraisal of thtmsilvts— 1n gtntral, In rtlatlon with pttrt, 
and In school situattons. 

ThtrtS*trt no significant difftrtncts which favortd tht 3 on 2 ovtr 

12 13 

self-contalhtd groups on any of tht stif-appralsal subscalts. * 

Qutstlon Z ' Do *3 on 2 studtnts havt mort favorablt attltudts about 
$chool--1n gtntrtl , In rtlatlon to school social structurt and c 11 matt, 

and in relation to schcyol authority and control— than studtnts In 

sel f-conta1j^ classrodJtTs? ' 

Thfe Student Attitude Inventory contained three subscales referenced 

to each part of this objective. Here, only one of the three variables, 

"attitudes about school tn general," favored 3 on 2 students. There 

were no significant differences between the 3 on 2 and self-contained 

groups on the social structure and climate and the authority and control 

14 

subscales of the School Sentiment Indices. 

. Question 3 : Do 3 on 2 students view themselves as being more 
independent of teacher directions in their school , work (niore self-directed) 
than students in self-contained classrooms? 
No! J 

One scale, the "Me and School Index," included ten questions such 

as "I like to have a tfeacher tell me "what to do next in my schoolwork" 

and "I like to choose my Own activities in class." There were no 

significant differences in scores on t^is scale between students in 

15 

3 on 2 and those in self-contained classrooms. 
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Qutl.tlonJ r Art tNtrt, ptrhapi, somt rf$1clu«l tfftcts of 3 on 2 
classroom txptrltncts that art Idtntlflabit In tht atiltudts and fttllngs 
of studtnts lattr In thtir tltmantary schooling? 

No! 

r ■• 

In tht Fall of 1976, tht Studtrrt Attltudt Inytn^ry was admlnlsttrtd 
to tht samt samplt of sixth gradtrs Idtntlfitd for tht SAT rtading and 
mathtmatlcs achltvtmtnt ttsts. 

Onct again, no significant dlfftrences wtrt found on scorts of any 
of tht stvtn subscales favoring studtnts who had sptnt at Itast thrtt 
years 1n 3' on 2 classrooms ovtr thost who had spent at least three years 
In self-contained classrooms during the primary grades, kindergarten 

1 fi 1 7 

through grade three. ' It should be noted that the one subscale, 
"attitudes about school In general," which favored 3 on 2 students 
tested In the third grade, did not differentiate between the two groups 
In the sixth grade testing. 

In summary , seven affective subscales In the Student Attitude 
Inventory were administered to students--(l) general self-appraisal, 
(2) self-appraisal in relations with peers, (3) self-appraisal In 
school si tuatloiw, (4) general attitudes about school, (5) attitudes in 
relation to school social structure and climate, (6) attitudes In relation 
to school authority and control, and (7) Instructional self-directedness 
of students. These subscales were administered to two groups of students 
In the third grade. One group had studied In 3 on 2 classrooms for at 
least three years and the other group had studied in self-contained 
classrooms for at least three years. The subscales were also 
administered to two groups of sixth graders. One group had studied in 
3 on 2 classrooms during the primary grades for at least three years and 



tht othtr group had ttudltd In st1f»contt1ntd classrooms du/ing tht 




primary gradts for at Itast thrtt ynrs. 

Tha rtsults for tha afftctlva artai art consiiUnU^ tha sama—no 
significant diffartncts. (As has baan notad, thara was ont contradictory 
rasuU In tha third grada tasting whara "aftltudts about school in 
ganaral" favorad 3 on 2 students. This finding did not ho1d» howavar» In 
tha sixth grada tasting whara thara wara no significant diffarancas. ) 



Summary of Rasults on A&hlaving Program Goals 

Ovarall, tha 3 on 2 Program has failad to produca any graatar gains 
on tha cognitive and affactiva program object ivas than tha outcomes ^ 
produced in sal f-containafd classrooms. Following are program goals followed by 
statements showing failure to meet the stated goals. 

1. To acquire basic academic learnings. 

A. The reading achievements of 3 on 2 students are no better 
than those of students in Sel f-Contai ned classrooms. 

B. The mathematical skills of 3 on 2 students are no better 
than those of students, in self-contained classrooms. 

2. To develop autonomy in learning (self-direction). 

Students in 3 on 2 classrooms are no more self-directive than 
students frT^el f -contained classrooms. 

3. To develop a more realistic and positive self-concept. 
Students in 3 on 2 classrooms have no better self-appraisal in 
general, in relation to school, or in relation to their peers, 
than is the case for students in self-contained classrooms. 



X 



4. 



To establish satisfying interpersonal relationships. 



The school sentiments- of students in 3 on 2 classrooms are not 



different-from those of students in self-contained classrooms. 
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Int«ract1ons of socio-tconomic status (SES) with cldssroom 

organization on a ftw varlablts wtrt rtportad In tht footnotes for 
comprehfnslvtness of rtportlng. On thtst ftw varlabUi, students from a 
particular leVel of SES (low, mtdlum, or high) appeared to do better in 
one classroom organization over the other. Since these Interactions were 
reversed between levels of SES, they do not favor 3 on 2 over self- 
contained classroom organization. 

Thus, the 3 on 2 dream, as It pertains to Improved student 
achievement in the cognitive areas of reading and mathematics, and as it 
pertains to improved student attitudes, continues to be a dream--a dr^am 
that eight years later still has not come true. 

■ 

The Views of Teachers, Parents, Principals 
TrTd Other Citizens on the 3 on 2 Program " 

Although this evaluation team believes that 3 on 2, like any 
educational program, should justify itself on the basis of student 
educational outcomes^ the team collected data on the history, operations, 
and characteristics of the 3 on 2 Program. This information was garnered 
from many sources. For example, there were six open hearings, widely 
publicized, to which all interested citizens were invited. Interviews 
were conducted with officials in the executive and legislative branches 
of state government, with Board of Education members, with Department of 
Education leaders, and with teachers, parents, principals, district 
school leaders, students, and other interested .Citizens. Questionnaire 
data were collected from teachers, parents and principals in the Spring - 
of 1976. All of the state's 2,379 primary kindergarten through grade 
three) teachers were invited to complete a questionnaire. Three-fourths 
of them did. All of the state's 175 elementary school principals were 
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InvlUd^o complttt a qutitlonnalre. Eighty-two ptrctnt of thtm did. A' 
random sampit of 1.897 partnti with chlldrtn In 3 on 2 claisroomt or • 
stlf-contalntd classrooms w«r« Invlttd to compl«|j|qu«st1onna1rti. 
Fifty-ont ptrctnt of thf paV*tnts did. 

In addition, two othtr qutstlonnalrts wtrt distrlbuttd In tht Fall 
of 1976. A random sampit of primary (kindtrgarttn through gradt thrtt) 
taachtrs wtrt Invlttd to complttt a "Ttachtr Vltws of Classroom 
Instruction" questlonnalrt. And, a random sampit of fourth gradt ttachtrs" 
wert invlttd to complttt a qutstlonnairt dtsigntd to asctrtain If thtrt 
were observed differences between students in 3 on 2 clasirtKxns and those 
1n self-contained classrooms during the primary grades. 

Teachers' and Pa^gnts' Views on Pupil Achievement 
of Cognitive and Affective Objectives' 

, How do teachers and parents view the 3 on 2 classroom organization in 
relation to the s«lf-contained classroom organization on cognitive and 
affective objectives? 

Reading and Mathematics : Ther#were no discernible differences 
between the descriptions provided by teachers in 3 on 2 classrooms and 

those in self-contained classrooms regarding the average progress of 

18 

students in their classes iji reading and mathematics. 

Grade four teachers were asked if they could identify which of their 
students had been in 3 on 2 and which had been in self-contained class- 
rooms. Only the data from those who replied in the affirmative are 
reported in this section. 

A greater proportion of grade four teachers indicated that th^ 
statements "are well prepared in reading" and "are well prepared in 

19 

arithmetic" were more,^ true for self-contained than for 3 on 2 students. 

r 
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Becoming Independent Learners : Teachers of 3 on 2 classes and 
teachers of self-contained classes described the progress of their students 

toward "becoming Independent learners" In very similar ways--no discernible 

20 

differences. ^ 

Again, a greater number of 'grade four teachers indicated that the 
statement "are self-directed learners" was more true of self-contained 
students than of 3 on 2 students, with approximately half Indicating 
"no difference. "^^ 

/ Exercising Sel f-Control : The 3 on 2 and the self-contained classroom 

teachers described the progress of their students toward "exercising self- 

22 

. control" 1n a very similar way--no discernible differences. 

Twenty of the 51 fourth grade teachers Indicated that the statement 
"misbehaves frequently in class" was more true of 3 on 2 students. No 

teacher felt this statement was more true of students from self-contained 

23 

classrooms. \^ 

There was no difference between the way parents of 3 on 2 students 

and the parents of self-contained students described the self-control 

24 

exercised by^their children while at home. * 



Wise ulti of Time : There were no discernible differences between the 

way in which 3 on 2 and self-contained classroom teachers described the 

25 

average progress af their students toward "using time wisely." 

A greater number of fourth grade teachers felt the statement 
"plan and use their time well" was more true of self-contained students 
than 3 on 2 students (23 compared to 10, with 15 "no difference"). 

There was no difference between the parents of 3 on 2 and self- 
contained children in their description of the way in which their 

27 

children spent their time at home. 
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Dtvtloping a PotUlvt Stlf-ConctPt ; Thtrt wtrt no dlictrnlblt 
dlfftrtncti bttwttn tht dttcrlptlont providtd by 3 on 2 tuchttrt and by 
ttachtrs of st1f-conta1ntd daisti on tht avcragt progr#st of thtir 
classts toward "dtvtloping a mort potltlvt ttlf-conctpt.", 

Ovtr hilf of tht fourth gradt ttachtrs Indlcattd thtrt wis no 
difftrtnct for tht two groups In tht posltlvt stlf-lmagt thty posstsstd. ' 

Gttting AJbng with Othtr Childrtn ; Thtrt was no dlsctrnlblt 



difftrtnct bttwttn tht dtscrlptlons providtd by ttachtrs of 3 on 2 and 
self-contalntd classts on tht progrtss of th^lr dassts toward "gttttng 

along with o^hai^ childrtn. "^^ 

Approximattly two-thirds of the fourth grade ttachtrs Indlcattd 

there' was no difference between the two groups 1n their ability to "get 

31 

along well with other students.' 

There were no discernible- differences in the descriptions by parents 

of 3 on 2 students and parents of self-contained students about the honesty 

and openness of their child's communication and the ability of their^ child 

32 

to get along with brothers and sisters. 

In smmary , reported above are the views of teachers and parents on 
the rate of student progress toward meeting cognitive and affective 
objectives. Although these objectives have been described as important 
ones for 3 or> 2 classrooms, there were no differences reported^ in progress 
which ^favored the 3 on 2 classrooms. These data reinforce th^ student test 
data 'reported earlier which failed, emphatically, to make a ciise for 3 on 2. 

views on Other Objectives ^ 

At given points in time since the inception of 3 on 2, particular 
■objectives have been enunciated which are not related directly to student, 
educational outcomes. However, sme of the objectives, if achieved. 
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would b« siyDportlve of cognltlvt and afftct1ve-Qutcom«s. Whtrt data are 
avallablt, th« views of ttacharsv partnts" Ind'prlnclfwiTs on th«a ^ 
objectlvts art reporttd. 'v^'i " 

To Incraasa CounsaUng $arv1ca> for*; fapLllt" artd Wants : Tht 

7 [ — ■ *-r — — — — t-**--T • . ■ 

objectlva "to Incrtasa counstling sarvlces for pupils and part nti" Is, 
no doubt, a worthy ont; but there Is nb' tvldenct that the objtctlva was 
either pursued or athleved In 3 on 2 classrooms more than It was in 
sel f-conta 1 ned Via ss rooms * The" objecti ve was vTe*^ a^ be Tng~equeVl3^^^^^ 

Important by teachers 1n 3 or\ 2 classrooms dnd those In self-contained 

33 '4' ' 

classrooms.^ 

related objecti vej that of planning and conducting. conferences 

with parents, was viewed similarly. No discernible^ differences In the 

Importance of this goal were observed between self-contained teachers and 

3 on 2 teachers; correspondlng-ly, the relative frequency of parent-teachep 

34 

conferences, as reported by the parents, was very similar. 

• , ■ - * ♦ 

To Assess Each Pupllks Educational Progress : Th^ objective of 
as^sesslng each pupil's educational progress was viewed asr being equally 

Important by teachers In 3 on 2classrooms and tho^e In self-contained 

, 35 . 

classrooms . , ^ . • ' 

To Accommodate Students with. Special Needs : The majority of the 
sample of teachers and principals believe that both 3 on 2 and self- 
contained classrooms are appropriate for children with short attention 
spans, children of high, average, pr low ability, children With behavior 
problems, shy children, and children- with varying socio-economic 

backgrounds. However, most of t+ie teachers believe that self-contained 

36 

classrooms arfe more appropriate for children who lack self-direction. 

The majority of the sample of parents believe that childreii^wi th the 
following characteristics should not be placed in 3 on 2 clas 
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"children with learning problems." and, "children who lack self- 
direction." A third or|itiore questioned the alv1$«b1l1ty of 3 on 2 fpr 

"children with short attention spans." "children who learn slowly." and 

37 

"children who don't behave well In school." 

' , ■ t . ■ 

Apparently, judging from the above observations by teachers, 
principals, and parents, the claims that 3 on 2 classrooms offer special 
opportunities and provide special attention to children with special neitjls 
are not claims shared by the majority o.f^;teachers . principals, and 
parents of primary grade students. , . 

• To Provide for Variable Grouping : One objective related to the 
effective operatton of 3 on 2 is to provide for variable instructional 
grouping of the students based on the nature of the learner, the / — 
determination of what needs to be learned, and the nature of . instructipnal 
activities. 'H'here was no discernible difference between the way in which 
teachers of 3 on 2 and teachers of self-contained classes viewed the 
importance of individual diagnoslfis of student learning. There was, 
however, a small difference favoring 3 on 2 in the importance of the 
goals related to the formation of groups: flexibility in. grouping 

students, use of small group instruction, and one-to-one pupi 1 -teacher 

38 " 

interactions. 

Vo Provide for Flexible Scheduling : The objective of allowing 
pupils to progress at%heir own rate of learning was viewed as being 
equally Important by teachers of 3 on 2 classrooms and those 1n self- 
contained cl assroom*^"^^ 

To Provide for Flexible Use of Classroom Space : Three-on-two teachers, i 

•comparison to seTf-contained teachers, rated the goal of flexible use of 

40 

classroom space sliglitly more positively. .. 

■•■ ■ r 
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In summary , each of the objectives described above :rtfers to 

operational objectives stated as part of the program specifications for 
'3 on 2 classrooms. TNvevldence collected In this evaluaMdn Indicated 
only a small dlfferen^e^ln the importance of these program stipulations 
as viewed by 3 on 2 ^achers and self-contained teachers; the small 
difference, when it did occur, favored 3 on 2. Class>*oom Observational 

__da_tAi__repo_rted_ Later Jn this rep_ori:_, _$uggesA Jha.t_dj fferen 

i mp 1 erne nJ/it ion of these goal statements between 3 on 2 classrooms and 
self-contained classrooms again slightly favOr 3 on 2. What Is Clear, 
though, is that despite the differences in goal statements summarized 
above, 3 on 2 students do not perform in a superior manner on any of the 
program objectives, as previously noted in this report. 

Basic Deficiencies in Design and Operation of 3 on 2 

There are some fundamental problems associated with 3 on 2, Some 

of these problems date back to the conceptualization and design of the 

organizational mode; and^ gtiier s have plagued its operations over the 

« 

years. 



d* others 

♦ 

The team has alread^^^tatl ishe<^the failure of 3 on 2 to yield 



greater educational outcomes that) vthosej^^,$elf -contained classrooms. 
In this section, some of the concf Jt^jJ^ji^^^^^^^^ operational problems 

of 3 on 2 are identified jl]^^^li^cus9^ 

1. Three on Two v5i'2''?iit<>t'^^ugyrate as an experimental program"; 
rather, it began with the exp<^^5ed objective "to eliminate the self- 
contained classroom in ki_nde|rgarten through grade three and eventually 
grades four through six."^^ While the impletnentation strategies called for 
program evaluation, the objectives were clear that within six years, all of 
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- primary «ducat1on was to b« 3 on 2 and pha$e-1n would begin in the 

'.V ji' - 

seventh year with grades four, five and six. Thus, the goodness of 
S on 2 was assumed before the first classroom was organized, a most 
unusual and unwtrranted IntrMu^tlon of an Innovation. 

2. Objectives of 3 on 2 have been ambiguous since Its Inception 
in 1968. 

Retrospective objectives which have been written Intermittently since 
1968 have changed over the years. These changes have Introduced 
Inconsistencies that thwart efforts of teachers and principals to 
implement 3 on 2. 

The evaluation team has identified and reviewed 29 sets of objectives 

which have been written since 1968. These objectives have emanated from 

^ 42 
offices of the DOE and reports of legislative committees. 

Although some themes appear to cut through the various sets of 

objectives (e'.g., team teaching, vertical grading, variable teacher-pupil 

ratios, attention to pupils with special needs— gifted and slow learners), 

there. are new objectives introduced from time to time (e.g., affording 

counseling time to each teacher, promoting diagnostic teaching, 

individualizing education, and eliminating the need for hiring 

substitutes). 

Objectives of 3 on 2 which have been written have not been 
communicated with sufficient clarity for teachers to implement or for 
parents to voice informed opinions about the placement of their children 
in 3 on 2 or self-contained classrooms. For example, responses to -the 
questionnaire revealed that only about one-fourth of the parents claimed 
to "know very much about t^ie program."^^ Furthermore, approximately 
two-thirds of the principals did not belie^^e parents understand enough 
about the 3 on 2 I^Vogram (or schooling in general) to make that choice 
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wisely* About half of the primary grade teachers who responded to the 
question did not believe parents have enough Information to make the 

AC 

. choice wisely; another one-^thlrd of the teachers responded "don't know." 
^rthermore, most parents said that they were not given a choice In the ' 
classroom assignment of their children. Most of the teachers agree; 
and forty-two percent (42%) of the principals of schools with both 3 on 2 

r 

and self-contained classrooms acknowledged that parents were not given a 
Choi ce.^^ 

Primary teachers were asked If th^ 3 on 2 Program Is limited by a 
lack of specificity about program goals andvprocedures ; and a substantial 
number (over one-third) of the 3 on 2 teachers either agreed that there 
Is a lack of specificity or they Indicated that they "don't know." Of 
the self-contained teachers, seventy-seven percent (77%) either Indicated 
that there is a lack of ^pecl fid ty for 3 on 2 program objectives or- that 
they "don't know."^'^ 

The teachers were asked to rate from "very great" to "very little or 
none" the extent to which 22 different goal statements were goals 

of their classes. Responses of 3 on 2 and self-contained teachers are 

48 

notable by their similarity. 

Overall, the objectives of 3 on 2 education which have been 
enumerated are not appreciably different from objectives of all primary 
education in Hawaii. Indeed, the first set of objectives published by 
the DOE acknowledged that, "Specific learning outcomes are the same for 

4 

all children whether they are placed in 3 on 2 or self-contained 
classrooms. These are: to acquire basic academic learnings; to 
Increasingly develop self-direction; to develop a more realistic and 
positive self-concept; aimi to establish satisfying Interpersonal 
relationships."^^ This same point was reiterated in subsequent 
70 
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statements. These overall educational objectives were extended and 

51 

■ modified In other program documents of a more comprehensive scope. 

Attention hai already been called to the ^ fact that 3 on 2 objectives 

i . 

changed from t1me-to-t1me. The point here 1$ that 3 on 2 lacked objectives 

which were unique, and which were stated with sufficient clarity. The 

charge to 3 on 2 teachers seems to have been "do what everybody else Is 

— supposed to be doing, -but do it n»re-ef-fectlve1y.--_ ' 

3. Contrary to the well-established principle of program planning 

and development that "form follows function," 3 on 2 was designed as an 

organizational form without a clear understanding of educational outcomes 

or functions which were to be served by the new classroom organization. 

In 1973, then Superintendent Dr. Shiro Amioka reported to the House 

Education Committee that, "The 3 on 2 Program is not a program per se 

but' rather may be described as an organizational pattern which makes it 

52 

easier for teachers to individualize instruction." 

An organization without a program invites a wide variety, indeed a 
hodge-podge, of programs for the structure. The team discovi^d that 
such has been the case{ making the use of the term "program" .for 3 on 2 
Subject to anybody's definition. One teacher observed that in her school, 
- "Two out of three of the 3 on 2 il asses. . .are being taught like self- 
contained classes. Each 3 on 2 class is divided into three groups, one 

c 

group is usually taken to another available rpom to minimize the confusion, 
distraction, noise, movement, and behavior problems cause by large 3 on 2 
classes. "^^ 

4^ Contrary to another well-established principle of program 
planning and development that "those who are expected to implement a 
program are involved in its design," 3 on 2 was conceptualized and 
designed with no appreciable participation or input from teachers and 
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principals. As a constquanct, this abtanca of profasslonal Input has 

rendered the "program" of questionable educational merit. 

There U no small amount of folklore about how 3 on 2 came about. .,1 ^ 

Some claim It was the brainchild of the Superintendent; others claim the 

Idea belonged- to the Senate Education Chairman. Still others think it 

came from the DOE's Research Division. Teachers know the idea was not 

theirs; and principals know tfce Idea was not theirs. In response to the 

question, "Who was primarily responsible for the decision to Implement 

(or not to Implement) the 3 on 2 Program In your school?", ibout one-third 

of the primary (K-3) teachers Indicated that the^ thought the principal 

was responsible, about eighteen percent {^8%) thought the DOE was responslbl 

while one-third indicated they did not know. By far, thejROSt prominent 

55 

answer to the question by principals was "I don't know." 

With an unbelievably short notice (approximately two summer months) 

teachers and principals were told to "tool up"' for a new program which 

would eventually eliminate every self-contained elementary classroom In 

the state! And, Initially, 218 new teachers were to be employed. 

Teachers and principals were told (on July 25, 1968) that, "The plan Wtll 

begin operation in September 1968, through state designation of the nunper 

of teams to be employed In ea^h district, and subsequent district^. 
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Identification of coequal teams In select schools." 

5. By definlUon and in Vactice, the 3 on 2 teams are without 
effective leadership for p] anni'hq^^* Team menjbers defined as "coequals" 
without a designated 'team leader. _ * ih . 

^In the first official publication of 3 on 2 objectives and ^ 
implementation strategies,^'' the teams of three teachers were described 
as "coequals." That term has ' persisted over the years. Why some 
guidelines were never established for designating a team leader, or a 

?3 ' • ' 



system of sel f-stltct1on. 1$ unknown. The ttachlng tetms found various 
schwnts for assignment of responsibilities among members of teams- 
annual rotation, alphabetical rotation, dally rotation* self-appointed 
leaders, and others. If everybody's responsibility Is nobody's 
responsibility, then, for certain, nobody's responsibility Is nobody '» 
res pons 1 bi tity. One teacher stated the case succinctly, "Because of our 
human weakness, it was eesi^ to 'pass the buck' --whether It was record- 



keeping, general ^booe^eeping, disciplining of children--there was always 
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someone to do it if you 'forgot'." 

• 6. The composition of 3 on 2 teams is without a discernible 

rationale which is applied uniformly. 

Possibly, the most pervasive complaint of teachers and principals 

59 

about 3 on 2 was "incompatabi 1 ity of team members." This was not a 
surprising finding in view of the absence of role definitions for 
teachers as team members. Some teachers, anticipating the inevitable 
elimination of all elementary self-contained classrooms, caucused with • 



fellow teachers with wjpom they thought t^eycq^ld ge^a>ong, and 

"S. ' » IT ;v -^ J^ 

voluntarily turned teams. Others were *«ssigi>^«d ^4WA!"S by the principal 



Others stoutly/resisted teaming. Conditions were such that in 1970, the 
Legislative Conference Committee called for "a course of action to 
remedy the problems arising fr(ki incompatible teachers working together. "^^ 
7. The substantial cost of ,3 on 2 education beyond the costs of 
- self-contained classroom education cannot be justified to Hawaii taxpayers 
on the basis of educational merits of the program. 

Innovations in education typically are ^ostly and the 3 on 2 Program 
appears to be particularly so. Clearly, the question of costs could not 
be answered solely orf the basis of how much an innovation might be 
expected to cost. Rather, costs should be e;xamined in relation to the * 
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merits of th« innovation. Thus, « fundamtnUl qutstion about costs 1$ 
whethtr the conwitment of fiscal and human resources to an innovation can 
be justified of) the basis of its educational merits. How much is too 
much depends on the expected outcomes. This perspective prompted the 
team to pose two questions relating to 3 on 2 Program costs: 

a. To what specific ends are the 3 on. 2 Program resources 
commi tted? 

b. Can the commitment of such resources be ius^tfffed on the basis 
of the educational yield of the program? 

As indicated elsewhere in thisveport, there is ample evidence that 
the 3 on 2 Program was conceptualized as an organizational rather than a 
programmatic Innovation and has befen implemented essentially as such. 
There are no program objectives that are unique to the 3 on 2 Program. 
Whatever program objectives that may be attributed to the program have 
come from a general set of objectives applicable to all primary 
education in Hawaii. The answer to the question about specific ends to 
which the 3 on 2 Program resources are committed must therefore be in the 
negative. That is, such resources have been committed to no specific 
instructional purposes other than the overall program objectives 
fo^ulated for all primary education in Hawaii. 

Failing to produce results that are unique to the program does not 
mean necessarily that the program is without merit; commitment of 
resources to the 3 on 2 innoveytion could be justified if the program were 
shown to be more efficient in p\pducing the conmonly desired student 
outcomes. Unfortunately, as reported earlier, there is no evidence that 
3 on 2 has done so. On the contrary, the data in fact show thjit 3 6ri;;Z. 
students have not achieved better in reading than students in self- 
contained classes. Nor have they, performed better in mathematics: than 



thtir ttlf-contilntd counttrpart. In afftctlvt ar«as» tht sal f -cental ntd. 
studtntt havt dont jutt It wt1l at tht 3 on 2 ttudtnts. Not a tingit 
studtnt achlfvtmtnt arta tttttd thow«d 3 on 2 to bt' suptrlor to ttlf- 
contalntd clattroom 1nttruct1on. 

Subttantlal amounts of fitcal and human resourctt havt bttn | 
conwUttd to and, Indttd, txptndtd on 3 on 2. Although dttalltd cott 
data art not discusstd htrt, 1t 1s worth pointing out that dost to 



$9 million In additional ptrsonntl cost was txptndtd on tht 3 on 2 
.Program for tht past school ytar (197|W6). Tht corrtspondlng figurt 

projected for the coming school year (1976-77) 1$ well over $10 million. 
At this rate, each 3 on 2 student next year will cott taxpayers $355 
more than that which will be spent on the education of each student 
enrolled in self-contained classrooms. 

, Since the extra costs are not accompanied by increases in studtnt 

■ i' ■ 

educational outcomes or other evidences of educational merit, the ■ 
inescapable conclusion is Uiat the 3 on 2 Program, started in 1968 
perhaps with more enthusiasm than sound planning, in fact represents a 
long-term investment of fiscal and human resou»*ces without visible 
promise of payoff. The team reiterates its i>itroductory observation that 
substantial costs of 3 on 2 beyond the costs of self-contained classroom 
education cannot be justified to Hawaii taxpayers on the basis of 
educational merits of the program. 

Classroom Descriptions 

During^ ^he Spring data gathering site visit, membei;s of both teams 
vi^ted SChoMs In all of the state ' s^chool districts. Observations 
were carried out tji, 25 classrooms, bothO on 2 and self-contained; and 
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principals, teachers, parants, and students were Interviewed. These 
ichool visits were of enormous help to the team 1n gaining an under^liandlng 
of teaching and learning In Hawaii classrooms. The team members were 

struck by the great variety of classroom configurations and modes )of 
instruction. These variations occurred In 3 on 2 and self-conwined 
classrooms. As a consequence of this experience,' the Adversary Team 

decided that it would be useful to the overal 1 aval uat ion effq^ 
more controlled observ|tions in the Fall. The team sought assistance from 
a specialist in open education, and the project co-directors contacted 
Dr. Vito Perrone, of the University of North Dakota, a nationally 
recognized expert. Dr. Perrone recommended the services of one of his 
former research associates, Dr. Michael Q. Patton, Director of the 
Minnesota Center for Social Research, the University of Minnesota. 
Dr. Patton joihed the team for the Fall site visit, trained team members 
in the use of an observation interview guide to measure classroom 
instructional diversification, individualization, formal 1 ty-i nfopnal i ty, 
and centralization. Tiie team drew a random sample of schools, and 
randomly selected 3 on 2 classrooms (grades two and three) and self- 
contained third grade classrooms to observe. The teacher of each of the 
classrooms (in the case of 3 on 2 one teacher was randomly selected from 
the teajn) and at least OR^j;^andomly selected student were interviewed. 
Dr. Patton visited fourteen classrooms ah^ members of the yteam collectively 
visited 29 additional cl^jj^koms— twenty -one 3 on 2 and eight self- 
contained. 

Team members identified each classroom a<s to school district and 
organizational scheme and then described the observations in accordance 
with the following outline: 



ERIC 



76 



r 



ERIC 



. I. A.typ1cil..dty'$ schfdult, _ 

11. Clasiroom activities, tiptclally 1n tht ttaching of^rtadlng 
and fnathcma ties. ^ 

in. ProportlohaT txptndlturt of ttachtr's tliw iptnt during a 

typical day working with all of tht studtnts as a group, small 
groups, and Individual studtnts. 

IV. Ways In which studtnts htlp (or hindtr) tach othtr. 

V. Method of handling discipline problems In the classroom. 

V U 1 nd 1 V 1 dua l 1 za t1 on - 1 n~ t he c 1 a s $ room * — 

VII. Opportunities for students to make decisions among options or 
alternatives. 

VIII, Relationship of teacher and students. ,^ 
IX. Teacher contacts with parents. 
X. Description of teagher teaming (3 on 2 classrooms). 
XI. Other pertinent observations. 

62 

The classroom descriptions are included in the Technical Report. 

From these observations and interviews the tea*^s able to describe 
similarities and variations of classroom operations. There was, as might 
be anticipated, a wide rJnge in "overall individualization," a composite 
of scores on the separate dimensions of classroom structure 
(individualization, diversification, peer interaction, and decentraliza- 
tion). Dr. Patton, for example, observed a distribution of three 
classrooms rated high, nine rated medium, and two rated low. The 
Adversary Team observed a distribution of eight classrooms rated high, 
fifteen rated medium, and six rated low. Furthermore, from these two 
sets of observations the wide range in "overall individualization" was 
apparent in both the sample of 3 on 2 classrooms and the sample of 
self-contained classrooms. 

Team members were struck by the innovative nature of some of the 
self-contained classrooms. In one school,; for example, three 
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self-contained third grade teachers were teaming to teach specialised subjects 
In keeping with the special expertise of each teacher. In two other 
self-contained classrooms, Individualization exceeded that of any of the 
3 on 2 classrooms observed. Within self-contained classrooms, ft Is 
possible for the tether to achieve ttie same degree of Individualization 
expected from 3 on 2 teams. 

. ». 

Concluding Observations 

The evaluation teams were charged to evaluate the effectiveness of 
3 on 2. As the evaluation was being carried out, many questions were 
raised about th^ political and economic considerations of expanding, 
re^taining at the current level, reducing the scope, or terminating the 
program. Many wondered if 3 on 2 funds might be available for other 
educational uses if the program were reduced in scope or terminated. 
Others wondered what would happen to the tenured 3 on* 2 teachers If the 
program were reduced in scope or terminated. Still others wondered about 
alternative programs that might be adopted as replacements for 3 on 2 if 
the resources were retained by the DOE. These Issues are Interesting to 
the teams and are of enormous importance to the educational policy and 
decision makers in the state. However, these matters go beyond the 
charge of the evaluation team, which was obligated to study the program 
thoroughly and carefuj ly , and to "tell it like it Is." 

The Adversary Team has carried out its charge faVthfully. The team 
was obligated to study the data carefully and identify weaknesses of 
3 on 2. The weaknesses identified are legion. Yet, none have been, 
identified and reported which are not substantiated by the data. 

I 
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Th« tttm concludts that the 3 on 2 classroom organizational structure 
h*$ failed to provide educational outcomes beyond those of self-contained 
tlassrooms, that there are serious Imperfections in Its conceptualization* 
design and operations, and that, indeed it is not a program but a 
structure, a classroom configuration. The team has found little to 
reconwend it for the future. 

On the other hand, the decision-makers must be impressed, as the 
team was, by the range of talents {special areas of expertise) which 
this evaluation has shown to extst among primary teachers in both 3 on 2 
and self-contained classroom organizations. With the array of talents 
among the teachers; with the dedication bf Hawaii's citizens for 
achieving high quality education for their children; and with Hawaii's 

» 

educational leaders who fearlessly ask that their programs be studied and 
that the evaluators "tell it like it is," this team of evaluators 
concludes that the future is bright for the making of wise educational 
decisions in the s^tate. 
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FOOTNOTES 




1. 3 on 2 Evaluation >^;P9»^t 1976-77. Vol. I. Technlcti Rtport. Port- 
land, OR: Northwtst Regional Educational Laboratory, January 1977. 

2. "Hawaii 3 on 2 Student Enrollment by District, Program and Grade 
Level," mimeographed. Hawaii Department of Educa.t1on, corrected 
Novwnber 4, 1976. 

3. The 3 on 2 Program . Hawaii Department of Education, July 25, 1968. 



4. 3 on 2 Lonq-Ranoe Program Improvement PUns. 1974-1977. Hawaii 
Department of Education, Julv 1974. 



5. See Technical Report , Table 12 




6. Se# Technical Report , Tables 17 and 21 

t 

7. There was one Interaction of classroom organization with socio- 
economic status (SES). High socio-economic status (HSES) students 
In 3 on 2 classrooms scored higher than the HSES students In self- 
contained classrooms on ohe subtest, "Selecting Examples and Synonyms 
to Match Contextual Definitions." This relationship was reversed for 
low soclo-economid status (LSES) students, with LSES students In 
self-contained classrooms scoring higher on the- subtest than LSES 
students In 3 on 2 classrooms. (See Table ^0, Subtest 1.) 

8. See Technical Report , Table 10 

9. See Technical Report , Tables 17 and 21 

10. There were Interactions between classroom organization and socio- 
economic status on three subtests. HSES students In 3 on 2 class- 
rooms scored higher than HSES students In self-contained classrooms 
on the "Fractional Numerals and Number Words" subtest, while LSES 
students In self-contained classrooms scored higher on the subtest 

than did LSES students In 3 on 2 classrooms. (See Table 20, Subtest 6.) 

In contrast, HSE^self -contained students scored higher than HSES 
3 on- 2 students on two subtests, "Ordering Cardinal Numbers" and 
"Addition with Two-Dlgit Numerals." The pattern was reversed for 
LSES students. On the subtest, "Addition with Two-Dlgit Numerals," 
there was further Interaction with the use of Hawaii English Program 
(HEP) materials; I.e., HSES self-tontalned students In m)n-HEP class- 
rooms scored higher than HSES 3 on 2 students In non-HEPjclassrooijis, 
while the reverse was true for HEP classrooms.' (See Tables 23, 24 and 
25 respectively. ) 

11. See Technical Report , Table 30 

12. See Technical Report , Table 34 
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13. There was an interaction, of classroom organization with socio-economic 
Status on the subscale, "Sfilf-Apprai sal in General." HSES self- 

^ contained students had a more positive self-appraisal than HSES 3 on 2 
students. The relationship was reversed for medium socio-economic 
status (MSES) students; there were no significant differences for^ 
LSES students. (See Table 35.) 

14. See Technical Report , Table 34 

15. See Technical Repeat .^able 34 

16. See Technical Report , Table 37 

17. There was an interaction between classroom organization and SES on 
two subscales, "Self-Appraisal 1n -Relation to Peecs" and "School 
Sentiment in Relation to Social Structure and Climate." HSES self- 
contained students scored higher than HSES 3 on 2 students; whereas 

this difference was reversed for MSES and LSES" students. (See Table 39.) 
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42. See annotated bibliography of 3 on 2 doc imen t s . - fee hn fed 1.-^ RftPort . 

Chapter X. . . 
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43. See technical Report . Table H-6.2 * 
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45. See Technical Report . Table H-fi.l 

46. Se» Technical Report . Table H-6.3 

47. See Technical. Report . Tabie H-4.7.S 

48. ' See TgchRical Report . Table H-4.4 ' i 

49. - The 3 on 2 Program . Hawaii Department of Education .-iOuly 25,; 1968. ' 
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50. Subsequent statements include: Administrative Guide and. Implementa- 
tion Handbook . Hawaii Department of Educatjion, August 1969, and third 
Revision, July 1973; 3 on 2vProqress Report . Hawaii Department of 
• Education, January 1970; Testimony before the House Education Committ 
by Dr^ Shiro Amioka, Superintendent, January 31, 1973; 3 on 2 Program 
Imprq i ement Procedures Beginning in School Year 1975-76 , Hawaii 
"epar^ent of Education, 1^75. 
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■o53. Comment by one teacher on open-end question of Teachers' Questionnaire, 
54. See Technical Report . Table H-4.1 
55i 'See Technical Report . Table Ht4.1 . 

56. The 3 on 2 Program . Hawaii Department of Education, July 25, 1968. 

57. Ibid . , 

83 



ERLC ' I; V ; y 83 



58. Commtnt by ont ttachtr pn optn*«ncl qutstlon of Teachtrs' Qu«st1onna1r«. 
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Anyont who has ever observed or participated in a formal debate will 
agree that it is at the rebuttal stage that things really get Interesting. 

For It 1$ during the rebuttals that' the two adversarial teams really'^ake 

out after each other, attempting to refute the opposing team's ol^lms and 

to assail the weaknesses in the opponents' proposals. Similarly, the 

inembers of our Advocate Team had tieen looking forward to receiving the 

Adversary Team's report so that we could discover 'where they thought the 

Hawaii 3 on 2 Program was weak. We were eager to defend 3 o>i 2. 

It was with considerable distppoi/itment , therefore, that we read 

through the Adversary Team's heport when, on the appointed day in mid- 

1 

December, we received it in Portland, Oregon, The Adversary Team report fails 'v..- 
to spell out in crisp fashion Just what it is that our opponents think is , 
so Inadequate about tWife Hawaii 3 on 2 Program. Oh, \:here are'criticisms ^ 
In the* report, and plenty of them. Bulfirthe organization of the report is ' . 
such that we fpjund it necessary to read most carefully in order to ferret 
out^just what the ^dve/sary Team ideally believes are the major defects of 
3 on 2. 



Is by implication 



FurthermoVe, alchoug^ t1ie Adversary Team recommend! 
an outright termination of the program, they fail to" provi-de one legitimate 
counter-proposal for consideratibn. Meaningful educationaT evaluation 
should provide decision-makers wtth information needed to tnake choices - . 
among action alternatives. Where are the alternatives which the- Adversary 
Team proposes? We had hop«d~-to engage in sensible contrasts between the 
merits of the Hawaii 3 on 2 Program and one or more' counter-proposats set 
forth by our adversary colleagues. But such counter-proposals do not ' 
exist in. the Adversary Team.'s report. No, they imply that citizens of 
Hawa*ii shoilTd obliterate an eight-year, multimilHon dollar investment in 
educational improvement.' \ ■ *^ 
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No attention Is given to the financial, educational, or social Impli- 
cations of such a course of action. No effort Is made to explain the 
feasibility of dischargfng hundreds of tenured teachers, nor to calculate 
the economic Impact on the state that hundreds of unemployed teachers 
would create, nor to gauge the certain educational upheaval that vwuld 
accompany the massive shifting of . the non- terminated teachers throughout 

the state should' 3 on 2 be abandoned. No, Instead, the Adversary Team 

f 

merely suggests that the program be terminated. In our view, such a 

/ 

suggestion without an accompanying analysis of Its In^llcatlons Is not 
responsive to the needs of ^cls Ion-makers In Hawaii. 

The Adversary Team's Main Conclusions 

After reviewing our colleagues' report, we were able, we believe, to 

sort (Jut their main arguments. As we see it, the Adversary Team believes 

V 

that the Hawaii 3 on 2 Program, should be terminated because-r (1) Children 

in 3 on 2 dlaesee d-d not score substantially better on ^^he achievement 
and aff active' measuree uaed in the evaluation; (2) Hawaii educators do not 
view the Haixxii 3 on 2 Program as being access ful; (3) Even though a 
sexn^es of 3 ^6n 2 operational objectives appear to be viewed as more impor-- 
tant by 3 on 2 teachersy therse differences u'ere not sufficiently large; 
^(4) The ^Haixxii 3 on 2^ Program was net effectively installed^, nor ha? it- 
■heen properly nurtured since its inception; (5) The costs of the .Hawaii 
^ on 2- Pi^gram are excessive; (6) It is passible to achieve the same 
degree of 'individnaltzation in a self-contained alass as in a Z on 2 alaee. 
These, then are the j^dversary Team's major' points. How well do they 
defend .them? In our view, not well at all. Let's take these claims up, 

V 

point-by-point, to examine the^ir v2flidity. ' 
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ClftiiTI #1 : Childx^n in S on -2 dla§84i9 did not eoor^ 8i4b8tcmtially 
b€tt€r on th€ aohi€\f<0mni and aff0dtiv4 t4at^ ussd in ths evaluation. 
With respect Xo th1$ contention , our Advocate Team's In^lal report deals 
extensively with the numerous reasons that the kinds of testing Instru- 
ments jloployed In the evaluation were susptct. In alT likelihood, the 
flkbrdlzt^ eichlevement t|sts used were Instructional ly Insensitive to 
tfhlNPfec^s of "llie 3 on 2 Program. The criterion referenced achievement 
tests provided only after-the-fact Instructional targets, hence no targets 
at all. The pupil affective measures, prepared under considerable time 
pressure, failed to discriminate effectively between pupils, even within 
a particular subpopul ation such as the students in 3 on 2 ojr self-contained 
classes. In short, the results yielded by these measures r while sugges- 
tive, should hardly be considered definitive. 

But, one might ask, if you Advocate guys thought the measuring. 

instruments were inadequate, why did you agree to have them use^? After 

all, aren't weak measures worse than nol measures at all? 
> 

. Well, you'll have to remember the advocate-/idversary structure of 
this evaluation. According to our understanding of the groUnd rules, either 
team would have the right to go after data whith might be useful to its 
side of the case. Both teams agreed, in advanc^, to secure a wide- 
ranging array of potenti^illy relevant data. The test results, if they are 

« 

^ccepted without reservation', d^.indeed favor the Adversary Team's posi- 
tion. They fwd a responsibility to secure such data. Our t;eam would have 
^Iso,. ha* tfje 'coin toss put us on the' other side of the case. But if so, 
we would have expected that our opponents would-have exercised their 
proper responsibi 1 i ty .and pointed out any deficfefcies of the 'testing 
instruments u»ed . Merely because a testing device is employed does not , • 
automatically render its results sacrosanct. 



While our team would have b«en iubllant (and astonished) had the 
test results come out In favor of-3 on 2 kids, we were far from distressed 
that there were no significant differences between the 3 on 2 and self- 
contained youngsters. Given the natu»^ of the measuring instruments, 
such results were to be expected. Theyfare definitely not damning to^^fie"" 
Hawaii 3- on 2 Program. 



\ 



Claim #2 : Hiwaii i^dii^tore, do not view the Hccbxxii 3 on Pr^g^K^n aB 
being suooeseful. In a section of their report dealing with the views 
^of teachers, parents,, and principals, the Adversary Team attempts to ^ 
demonstrate that the 3 on 2 Program Is not viewed by "PTawall educators as 
being successful. Their attempt was |j decisive failure. Let's see^why. 

tn the flrstviflaceXthey accurate 1/ Identified the educational 
constituencies concerned, nW^yiretrchers , parents, and principals. These 
were the three gn?ups»|that both teams pe^^sonally Interviewed >and polled '^y 
' via questionnaires , Why Is It, then, that whe flg^ho Ari ypcate Team ge\5 
down to partl\:ulars, they almost wholly avoid r^rtlng any reactions from 
principals? After all , principals repreJsent a truly unique constituency. 
Whereas teachers, whether they are in a self-contained or, 3 on 2 class, 
may have partisan views because they are actually functioning in one of 
»»M the two situations being evaluated, there is no such built-in bias with ' 
■ principals who have bot'h 3 on 2 and -sel f-cohtaine'd classes Ar\ their 
schools. Suth principals, as experience educational leaders, are in a 
far better position to appraise objectively the relative merits of 3 on 2 
and self-contained classes. Why, then,s^ere principals' judgments largely 
.loverlooked by the Advecate Veam? The answer is all too clear. Principals ' 
evaluations were omitted because they represent an empha-tic vote of 



/ 



support for ttia Hawaii '3 on 2 Program. 



Having avoldtd principals' data for tht most part, tht Adyocatt 
Ttam than prtstnts a sampla of ayaluatlons from fourth gra^*1tVachtr$ . 
rtgardlng tht marlts of various asptcts of 3 on 2 and stif-contalntd 
classts. Thtir fourth gradt tfachtrs conslsttntly fall to rtport any 
dramatic advantagts for tht Hawaii 3 on 2 Program. What a totally 
unstartllng finding! 

Ltt's rtcognize ju^t what's going on htrt. A group of stlf-contalntd 

ttachtrs 1$ bting asktd to judgt/tht rtlatlvt wortlr of 3 on 2 and stlf- 

• J. * 

cental ntd classts. Is It not compltttly prtdlotablt that ttachtrs of 

stlf-contalntd classts would vltw with mort favoi» that samt organizational 

structure tvtn It If occurs at a lowtr gradt Itvtl? That's Hkt asking a 

group of RepubUcah' govtrnors to appraise tht rtlatlvt worth of Dtmocratic 

versus Republican mayors. Impartiality Is Impossible. 

We want to emphasize tht point that the fourth grade teachers' fail- 

u ret to be supportive Of the Hawaii 3 on 2 Program dots not constitute 

significant evidence. Indeed, it may inerely represent the partisan view 

of a potentially biased group. 

In addition to the many responses from fourth grade teachers, the 

Adversary Team reports severv contrasts (pages 13-15) between 3 on 2 and 

self-containe^ based on the reactions of the numerous K-3* te&fthers 

whose opinions Were gathered via questionnaires. In all seven of. 

these contrasts (\r example, with respect to such factors as reading 

acn-ievement and wise\jse of time),Uhe Adversary Team reported that 

there were no substantWl differences between the teachers in self- 

ontalnecT classes and those in 3 on 2 classes in their perceptions of 

'pupils' average progress with respect to these seven characteristics. 



The characteristic phrase used by' the Adversary Team was that there were 
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"no disctrnlble dlffertncM" between th» descriptions provided by the two 
teacher groups. 

The Adversary Team again used such data to support their contention 
that the Hawaii 3 on 2 Program falls to secure support from Hawaii tdu-^ 
cators. They fall to^jjote, however, that/there were other questions 
addressed to the teaohtri of Hawaii which fall to coincide with that con- 



tention. For example, as reported by our Advocate Team, over 85 percent 
of the 1,175 3 on 2 teachers polled and over 50 percent of the 574 self- 
contained tjwfchers polled want to maintain or expand the Hawaii 3 on 2 

\ "t ' ' ' ' 

Program . That hardly sounds like a repudiation! 

But let's look more closely even at the seven contrasts re^rted by 
our ccWleagues from the Adversary Team. If we Inspect the data carefully, 
we see that when the two groups of teachers were asked to report whether 
their student^were making "very gr*at" progress, tn six of the seven • 
contrasts a dlfference^ln jfav^r-'Of 3 on 2.>was reported . Does this sound 
like "no d1scfir^1|}le difference?" It doesn't to us. 

J^n essence, then, we do not believe that the Adv<*rsary Team has even 
fOme close to supporting their contention that Hawaii educators fall to 
endot'se'^ the Hawaii 3 on 2 Program. To the contrary, the manner 1n which 
our colleagues have handled the data dealing with this question suggests 

that they recognize their vulnerability op this score. As the Advocate 

• * V 

Team demQnstrated accurately^ In 1ts"or1g1nal report, the principals, 
'teachers and parents of Hawaii are all supportive of the Hawaii 3 on 2. 
Program. -In thelV view, the Hawaii 3 on 2 Program Is working . 

( ■ , . ■ - . : 

Claim E'l^w^ though a seizes of 3 v^n 2 operational objeotives 

appeaiJ^t^%e viewed ae more 'important by 3 on 2 teaofiersy these difference s 
were not-'auff-ioiently large. ■ Frankly, we were i)erplexed regarding this 
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entirt section of tht Adversary team's report. Old they Include It to 
demonstrate that 3 on 2 teachers believe tOch procedures as 1nstruct;1onal 
grouping are more Important? They d14 just that, of course, and we're 
delighted. Our onlj^ guess Is that our colleagues wert looking for largtr 
magnitude differences favoring 3 on 2 teachers. Otherwise, this section 
9f their report apjpears to favor our case. 

Claim #4 : Ths Hawcdi Z on 2 Progryan waa not ^ffmotiv^ly installed, 
nor has it been properly nXirtured einae its inception. W« concede this 
point without debate. It is precisely because of the manner In which the 
Hawaii 3 on 2 Program has been Initiated and coordinated by the DOE that 
Its full Instructional potential has not been realized. Yet, as we 
contended In ourforlglnal report, even though the Hawaii 3 on 2 Program 
Is working, we want It to work even betteH l 

It Is for this reason that we set forth a series of tangible proposals 
to provide more effective POE guidance for the program. -We feel that the 
fact the Hawaii 3 on 2 Program has Succeeded, In spite of the Adversa\^y 
Te'am's claims about the lack of DOE support It has received. Is a y1ndV^ 
cation of the pi^gram^s basic soundness. 

Claim #5 : The aoats of the HGomii S on 2 PvogroTn are exQedsive, 
In the final Veport of the Adversary Team It Is stated thai "eaqh 3 on 
2 student next year (1976-77) will cost taxpayers $355 inore than that 
which win be spent on the education of each student enrolled In self- 
contained classrooms." This statement is false. 

The average elementary teacher's salary and benefits Is $20,956 and 
for educational assistants Is $8,843.^ The average state enrollment for 
self-contained classes is 26 students, while the average for 3 on 2 classes 
Is 59. Thus the ^taff costs per pupil for Self-contained classes is $806 



I 

while the cost for 3 on 2 classes is $1,066 and the cost for mocHfled 3 on 
2 1s $860. The cost for a self-contained class with a teacher and an 
educational assistant Is $1,146. At the sanie time certain Instructional 
materials costs are less on a per pupil basis In 3 on 2 classes than In 
self-contained classes because the materials can be shared across more 
students. For example, the HEP Lanugage Skills replacipint costs for 



X^l^'ll were $16.38 per pupil In self-contained classes but only $10.88 

2 



per pupil In 3 on 2 classes. 

In son*" 3 on 2 classes the student enrollment has risen to §4 
students. In t^^1s case the per pupil cost drops tp $982. With a modl- 
fled 3 on 2 class of 64 students, the per pupil cost drops to $793 which 
Is less than the existing per pupil cost In the average self-contained 
class. The point here Is that per pupil costs can be manipulated by 
changing the student/teacher ratio. 

In viewing the cost of 3 on 2 to the (X)E It should be in mind 
that the legislature has appropriated extra funds to finance 3 on 2 that 
are separate from the general .DOE funds. Thus, the funding of 3 on 2 did 
not cause the DOE to have to cut jDa<:k on other educational programs. At the 
same time, the money appropriated by the «tate legislature specifically 
for 3 on 2 cannot arbitrarily be used by. the DOE for other purposes. Several 
key 'legislators have stated In Interviews with advocate and adversary team 
members that If 3^ on 2 were terminated, the money would go into^the state's 
general revenue fund rather than remaining as discretionary funds for DOE 
use. The prospects are clear. If the Hawaii 3 on 2 Program «s termi- 



nated, the resources for ^education In Hawaii may be reduced drJi^atlcal ly. 
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Implications by the Adversary Team to substantially reduce or elim- 
inate 3 on 2 have serious cost considerations that cannot be overlooked. 
The elirnination of 3 on 2 ^iiay^ have disastrous financial and personnel 
"94 

^ i ^ s ' . . ' 7 ' • 93 



Vtp«rcu$$ Ions- for Hawaii sinct the program currently employs 485 
teachers, the vast majority of whom are tenured. Termination of 3 on 2 
would Involve reallocating some of these teachers and the possible 
termination of others since Hawaii does not currently employ that many 
probationary teachers vJR would be the first tp be let go. The Adversary 
Team has failed to address these crucial economic and humane problem^. 
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Claim #6 : It ie poaeihlB to aohiev^ the ffame degree of individu^ 
alitation in a self-oontairwd alas a as in a Z on 2 otasB. llhls cla1m» if 
subjected to any kind of logical analysis. Is patently falst^ It 1$ 
absurd to contend that a single teacher can create the same kinds of 
Individualization opportunities as might be dev1se(j^ where three teachers 
work togettier. The Individualization potential In 3 on 2 classes Is 
dramatically greater. 

And how do our Adversary colleagues suii)port this logically suspect 
claim? Well, fr\ October they received an hour or two's worth of training 
from an Individualization expert, then spent three or four days observing 
classes In operation. Indeed, they visited 21 3 on 2 classes' and only 
eight self-contained classes. Yet, on th^ basis of "'their scant training, 
their obviously partisan Interests, and a data-base of only eight seVf- 
contalned classrooms, they expect someone to believe that "within ^elf- 
contained classrooms, it is possible for tbe teacher to achieve the same 
degree of individualization expected from a 3 on 2 team." Incrediblel 

Reprise / 

^ summary, we have demonstrated that each of the major claims- made 
by the AdN^erjary Team is basically unsupported. They chide the Hawaii 
3 on 2 Program because "it 1s not a program, but a structure, a class- 
room conftguration. " Well, so what? If it's a c-lassroom configuration 
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that works, that's just fine. And the Hawajl 3 ofk 2 Program 1s working. 
It can work better, that's certain. We ha vH^ outlined a series of^ ^^ncrete 
proposals tO Improve 1t. Our bpponents offer only a vague Implication 
that the program be terminated. 

Jhey congratulate themselves for Carrying out their "charge faith- 
fully'' and for their ability to "tell' It like It Is." Ji>^|ltnNjew, their 
charge was to render an evaluation that would be helpful to Hawaii 
decision-makers regarding the Hawaii 3 on 2 Program, An Implied recom- 
mendatloQ that the program should be' terminated , not followed up by 
analyses of the effect? of such an action, provided little help Indeed. 

The Advocate Team reasserts Its chief recommendation namely , that 
the Hawaii 3 on 2 Program be maintained at Its present level as an 
Instructional option for Hawaii primary educatlorf, and that creative 
efforts to Improf^ the quality of the program be Initiated without delay. 

On the basis of that educational evaluation, the choice facing 
Hawaii deci sion^makers is clear: j 

(1) To terminate the Hawaii 3 on 2 Program . . 

(2) To maintain and improve the Hawaii 3 on 2 Program 

We believe that of these two options, for the sake of the chlldnen 
of Hawaii, the choice must be ti) maintain and improve ! * 




FOOTNOTES 

1. These figures and the way In which they were dtrlved are given in 
Table 47 in 3 on 2 Evaluatipn Report 1976;!77. Vol . ^,'fj»chpica1 -^ 
Report . Portland, OR: Northwest Regional Educational Laborafirr^, 
January 1977. 

2. See TechniGfl Report . Table 48. - ^ 
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Th« Hawaii 3 on 2 Program was evaluated through- the use of an advocate-adversary 
evaluation design. By random assignment, one team of evaluators (the Advocate Team) 
Assumed respohslbll Ity for Identifying strengths of the program; and the. other team 
(the Adversary Teyn) assumed responsibility for identifying' weaknesses. Both teams 
used the same bank of data, which Is reported in a separate- Technical Report.^ Each 
team has filed a report which was shared with the other team for rebuttal. This Is 

the Adversary Team's rebuttal of the Report of the Advocate Team.' 

1 

Recommendation and Conclusions of. the Advocate Team 
The Advocate Team has recommended that the 3 on 2 Program be maintained at Its 
present level. Conclusions advanced "by the team are: (a) the program 1$ working; < 

(b) 1t Is working because 1t possesses some unique instructional advantages; and- 

(c) It should be maintained as an Instructional option for the children and teachers. 

The Adversary Team will show that these conclusions are not supported by any 
eduQatlpnal outcome data. ^ 

Jystif icatlons Advjnced by Advocate, Team 1n Support of Its Conclusions 

T>ie fol/low1ng was advanced as evidence 1n support of the "1fs working" 
conclvUslon 

fi. Tf/e team claims to have visited, "some" 3 on'2 classrooms which rtad 
preV;i6tisly/ been identified by the district curriculum specialists as being excellent. 
Theiiteam (^1d not Identify hov/^ many such classrooms were visited (only one was 
deajcrlbed' 1r the Report)-. Nor did the team expTain why a biased sample of classrooms 
pnfylously determined to be "excellent" was selected for visitation rather than a . 

mofe scientifically defveqsible random selection of classrooms, which could have 

I; 

riiy'ealed a connxr^hensive view of them. 

2. The team reports results m)m a questionnaire item whicJM|sked elementary 

\ ' ■ 

principals, teachers, and parents what they feel should happen to the 3 on 2 

t«' ' ■* • ' ' ' 

il^fogram.- Half or more of each respondent category, or sub-category, indicated a 

jfreference to expand or keep it at its preserl* level. Not mentioned was tfie fact 
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I ' . .. 

thftt 50 percent of the respondents 1n two sub-categories, teachers |n self-contained 
classrooms and parents of students 1n self-contained classrooms, also recomnended 
reducing or' el Imlnating the program. 

3. Principals, whose schools had; both 3 on 2 and self-contained classrooms, 
were asked to titillate whether students In 3 on 2 or self-contained classrooms were 
making greater prepress on each of .14 areas of content, knowledge, and personal 

development, those-who selected" one of the two classroom organizations tended to -. 

believe that 3 on 2 students y^ere making greater progress. However; the- reader 
.must wonder why txie team did not report that 50 percent or more of • the principals 
believe there, are rro differences in progress between the two forms of classroom 
organization on nine of the 14 areas', and on the remaining five areas, at least -30 » 
percent said t>iere are no differences. Also, not reported were estimates of 
teachers on the progress of pupils in their Classes in these. same area>, which reveal 
no discernible differences between 3 on 2 and self-contained teachers for any of 
the 14 areas. 

Six presumed advantages of 3 on 2 advanced as evidence in support of the "It 
Is worj^irig because of unique instructional advantages'^" conclusion were: (a) flexi- 
bility to organize students, (b) teachers can instruct in their areas of strength, * 
(c) collegial interaction of teachers, (d) likelihood of compatible student-teacher 
relationships with three teachers in the room, (e) the instructional program can go 
on when a teacher is absent, and (fj. younger children can learn from older chi Idren. 

The following evidence was presented by the team to support the "advantages": 
s • LA specialist in individualized instruction thinks there is a higher than 

usual degree of real teaming in 3 on 2 classrooms than that he has found in other 
settings, on the rrta inland. 

2. "Large proportions" of parents identified four statements as ^lajor strengths 
of the^ program (from among 13 possible selections). 

3. Teachers agreed wi^h 3 of 14 positive statements descriptive of the 3 on 2 
Program; and principals agreed with ^ of the 14 statements. 
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Ev1d«nct prtftnttd by th* tt«m for '^'pr«^trv1ng th« pro<[r«m «s irn Initructlonal 
option" was derived from responses by principals, teachers; and parents to the 
*qutst1on, "How Important do you feel It Is to keep 3 on 2 as an option for those 
schools, students, and teachers who want it?" Most respondents thought it was 
ttther "veify Important" or somewhat important." 

In summary , the Advocate Team has recommfnded retention of the 3 on. 2 Program 
at its current level, on the strength of the followirig: (a) res^ponses to^ cumu- 
lative total of five questionnaire items selected from three questionnaires, one 
each completed by elementary principals, teachers, and parents; ,(b) team visits to 
"some" 3 pn 2 classrooms previously judged by district curriculum specialists to 
be excellent; (c) a specialist in individualized Instruction thinks the teaming in 
3 on 2 classrooms Is better than that he has seen on the mainland; .and (d) presumed 
inherent logic of the 3 on 2 classroom configuration. 

*That is all there is to the recommendation and>to the evidence advanced. . Ther 
is no more, A less than convincing case for expending $10 million next year, -afnd 
even more each year the protiram is continued at its present level ! _ 

The Rebuttal 

/» . " ■ ■■ 

This rebuttal is directed primarily to three aspects of the Advocate Team's 

Report: (1) unsubstantiated criticisms of self-contained classrooms; (2) the 

sparsity of data in support of concly/sions; and (3) the Team's falTure to consider 

student achievement. data. ^ • • 

* Unsubstantiated Criticisms'of Self-Contained CU'Ssrooms 

O^ie cannot fault the Advocate Team for supporting the 3 on -2 Program. That 

"is what it 'was charged to do--to identify and report strengths of the program. 

What one can and must fault , the team for doing, however, • is attempting to e'nhance 

3 on 2 by deprecating self-contained classrooms (an<^ teachet^s in self-contained 

classrooms). One section of the Report, titled "Self-Contained Classes--Self- 

CreaJted Problems," contains such unsub;5tantiated charges as: (a) "All too often, 

ton 



teachers In self-contained classes are obliged tjo assign wheel-spinning activities , 
to the rest of the class just so they, can give attention to those groups who , need 
It;" and (b) "the Idea of providing sustained attention to Individual learners must 
surely seem Illusory to the harassed teacher of a self-contained class." The team 
further asserts that It was because the self-contained class carried wltff It such 
"built-in liabilities" that Hawaii educational architects Initiated 3 on 2. The 

six "advantages" advanced for 3 on 2 are ones which the team asserts v •^can.nP^^^ 

present' in Ml single-grade self-contained classroom." While all of these claims are 
unsubstantiated, the most reckless threat 1*s that j^erious rvigatlve consequences- 
negative consequences that would be experienced by the children of Hawaii during 
their crucial, formative years" would result if 3 on 2 were eliminated or seriously 
reduced in magnitude. The team Jailed to identify what thesd serious negative 
consequences for cW44ren would be. Certainly there is no evidence to suggest 
they would lea/n less, or be less positively inclined toward themselves, their 
^school or their peers. - 

The Advocate Team implied that' the' level of competence of elementary teachers 
is a matter of chance. In its reflections on self-contained classrooms, the team 
stated, "II" we were lucky, we d/ew a good teacher and we learned." Presumably, 
3- on 2 would obviate this draw; all students would be lucky. Such an argument pre- 
supposes that (a) teachers are less than competent and '(b) working together, three 
less-than-competent teachers constitute a competent team. Neither of these 
suppositions ^s true in Hawaii" ^ No differences were registered in responses of 
-3 on 2 and self-contained teachers who were asked to indicate the percentage of timf^ 
in their own teaching when they did not feel totally confident in their subject 
matter competence.^ Both groups expressed a high level of confidence. Also, both 
self-contained and 3 on 2 teachers indicated they possessed a large range of instruc 
tional .strategtes.^ Further, there were no discernible differences between self- 
contained and 3 on 2 teachers* in the reported percentages of the work weeic they' 
spent in such activities as small .droup instruction, individual instruction,^ 
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-suptrvlsing seat work, preparation of lessons, and counseling with parents and 

individual students;^ nor were differences reported in goals of |:heir classes.^ 

Tht classroom observations revealed s^^lar classroom activity profiles.® Finally, 

97 percent of the teathers in each classroom organizational structlire indicated 

they felt "sure" or "extremely sure" in carrying out all of their teaching 

9 

responsibilities. 

Succinctly stated, since the pupil outcome data reveale^ no differences 1r\-- 
learning,^^ 3 on 2 has not proven to be a viable, workijig alternative to today's 
self-contained classrooms in Hawaii. 

The Sparsit^ of Data in Support of Advocate Team'-s Conclusions 

The overall evaluation design of 3 on 2 was unusually comprehensive. The 

data gathered includ^dhsognitive achievement test data at three grade levels 

(using multiple forms of tests), affective achievement data at two grade levels, 

two questionnaires completed by teachers of the primary grades, one questionnaire 

completed by each o/ the following: (a) fourth grade teachers, (b) parents of 

children enrolled in the primary grades, and (c) elementary School principals. 

There were classroom observation reports, printed documents descriptive of 3 on 2, 

and much more. The Advocate Team cited data from three questionnaires, but^was 

strangely silent on two others. The team cited only five Items from the question- 

lalres, from among a cumula^^lve tatal of more than 90 substantive' Items . The 

team manifested no interest^in objective classroom observation data. Furthermore, 

che team failed to use some printed Information descriptive of 3 on 2. For example 

.he team proposed, six advantages of 3 on 2 which, it maintains, were "not' plucked 

from any Department of Education document ..." Wonder why? Surely the team 

vould'not presume to claim originality of these "advantages" which are published 

11 ' ' 

in at least three documents made available to the team. 

Where- did all the data go'? All we're published in the Technical Report. ^11 
;ere available to the Advocate Team. They just weren't used by the team. 



Had tire team used the data, it would have found that those six "advantages" 

don't measure up. The first one, "flexibility in grouping students" is a goal of 

■ 1«2 

s^lf-conLained teachers as well as 3 on 2 teachers, and principals see it as "a 
13 

goal of both. Observations made by the Adversary Team, and documented in the 
Technical Report, revealed that teachers in six out of eight self-contained classr 
rooms observed regrouped their students into smaller, more homogeneous groups based 
on ability. Furthermore, 1n 15 Of the 21 3 on 2 cl-assrooms observed', teachers. . 
Indicated the students wej^e placed in essentially three groups for large blbcks of 

Instructional time; these groups are hot appreciably different from three self- 

f 14 t 

contained classes In one large room. 

The second claim, that the 3 on 2 team can capitalize on Its members' particular 

Instructional skills so thfd teacbers can instruct In their areas of strength? such 

as music, science, or aj»t, presumes that 3 on 2 ^eacih1r\g teams were formed qn the 

basis of each teacher's subject matter expertise. The, teachers , however, when 

asked how their team^ were formed, said by self-selection (47 percent) and by 
♦ 

personal compatibility (45 percent). Only 15 percent said "to balance subject 

15 ' " 

matter expertise. " » 

The third claim, that collegial interaction among 3 on 2 teachers makes them 
more professional, stronger teachers is not borne ou^ in the 'data; particularly, 
pupil learning outcome data reflect no d^ff§rVices favoring 3 on 2 teachers. 

The fourth claim, "children have a better chance of finding an adCilt to whom 
'they-can relate" is mathematically true (by a rati/of three-to-one). There seems 
to he a presumption, however, that teachers are by nature incompatible with a segment 
of their pupils, but that pupils in 3 on 2 classrooms, by shopping around, can find 
one compatible teacher. One. sel f-con tained teacher who had previously taught six 
years in a 3 on 2 classroom said that she was able tp know her students better in the 
s4l f-contained class,'^that students in 3 on 2 classes tended to play one teacher ' , 
against the others. 

r 
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"Ht fifth point, "whep one teacher Is ab$ent» Instruction 1n the classroom can 
largely undisturbed, by the other two teachers," seems to argue against the . 
nee3"ror three t^ichers. - • 

/Finally, the team's assertion that "younger children can learn *rom the older 
children In 3 on 2 classes" may be possible. However, the value of students' 

tytoring each other as a formal part of the Instructional program 1$ far from being 

t 

universally acclaimed by teachers. Twelve of 18 3 on 2 teachers interviewed In 

<■ ■ ^ .. • 

conjunction with classroom observations by the Adversary Teab Indicated that they.. 

do not believe In the practice; nine of them said student tutorinrg was more of a 

hindrance than educational benefit; and four of the eight self-contained teacherV 

17 

interviewed said It was a hindrance. 

In summary , data presented by the Advocate Team in support of Its conclusions 
and recommendations were unusually sparse. Advantages of 3 on 2 cited by the team 
are restatements of arguments first advanced in 1968 when the program was begun. 
In 1968, these statements were promises of what 3 on 2 might accomplish. Today, 
nine years iater^ they are still promises. Taxpayers have a right, indeed an- 
obligation^, to ask^hen will the promises become reality? When will students be 
Expected to learn more because "of this program? There are not yet any student 
achievement output data which favor the program. 

Failure to Consider Student Achievement Data 

The Advocate Team acknowledged that' results of the extensive testing program 
did not favor the 3 on 2 Program, but the team maintains it never expected the tests 
to Identify differences between students in self-contained and 3 on 2 classrooms. 
The fault lies in the tests, the team suggests, not in the absence of ^ctual 
differences which favor 3^ on 2. All of the tests were criticized. The nof^^ 
referenced tests (NRT) were criticized because they were norm referenced; the 
criterion referenced tests jCRT^) were criticized because of alleged "after-the- 
fact" use of the tests; and the affective tests were criticized because existing 



Instruments were .used rather than the evaluation team's undertaking the development , 
of new ones. 

These criticisms are not valid. , From the outset of the evaluation, it was 
recogMzed by both the advocate and adversary evaluation teams, and by the project* 

V 

co-directors tl^at students would need to be tested In the cognitive and affective 
areas, and multiple forms of measurement were selected. The selection of all tests 

was endorsed by both teams,- the project co-directors, and .representat1yes- of--th^ 

Hawaii Department of Education. ^ 

Use of Standardized Tests . In-selecting the standardized tests, particular 
attention was given to content val1d1ty--the extent of agreement of the test with 
the educational objectives In the basic areas of reading and mathematics. Additional 

♦ 

selection criteria included the appropriateness of the test material and suitability ^ 

18 

of the grade range of the tests for Hawaii students. 

Criticisms of the use of stands^rdized tests in program evaluation are' not 
unusual. Critics generally assert that the fesTs cannot detect differences when 
two or more programs are contrasted, and they cannot detect differences between and 
among' groups^, eVen when other data have reflected differences. 

The 3 on 2 evaluation, although comparative in nature, is not a program 
evaluati-on. Two programs wMth different or unique program goals are not being 
compared. Rather, 3 on 2 is an alternative classroom organization with the under- 
lying assumption that students in these classes "will exhibit greater gain than 



students in self-contained classes in attaining the program objectives which are 

19 

the same for all children regardless of classroom organization." Thus, arguments 

* 

against the use of standardized tests because of their inadequacies to identify 
unique program objectives are not pertinent in this evaluation. With the program 
.objectives (except- antic Ipated level of attainment) being the same for both groups, 
it Is reasonable to expect larger means on test scores of 3 on 2 than of self- 
contained classrooms because of the "treatment effect." The means, however, are not 

I r 

larger, ' . • /, • 
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Also, differences were consistently detected, as Expected, among the levels of 
socio-economic status. A In, that regard, the standardized tests did detect differences 
when differences were known to exfst. 

The cumulative ev-idence suggests strongly that there «re no differences^ in 
achievement for the tests to- detect, and that the Advocate Team has presumptuously 
attributed the failure of 3 on 2 to yield greater achievement gains on deficiencies 
of the tests. 

Use of the Criterion. Refer^enced Tests . Many who criticize standardized, norm 
referenced tests do s^o in conjunction with "pushing" another test fDrm, thd, criterion 
referenced tests. This is the position of the Advocate Team (except the team criti- 
cizes the use CRT in the 3 on 2 evaluation--criticisi»f^ whVsh surfaced after the-' 
tests failed to detect differences favoring 3 on 2). These arguments, CRT versus 
NRT, are for the mosi part hollow and "sloganese." Of importance are (a) that 

whatever tests are used be content valid and (b) that the tests be equally approp- 

?n 

riate for all participants. Both of these matters recei^Ved careful attention 

\ 

in the 3, on 2 evaluation. 

CRTs were used to supplement the standardized tests. These tests (12 

subtests) reUted more specificalTy to' subobjectives within reading and mathematics* 

than the standardized tests which measured (nore general objectives. The CRT's were 

selected with the same high degree of care and attentiorv as described above for 

21 

the standardized tests. ^ ' 

The Advocate Team's claim of "after the fact" administration of the tests is 
patently false. The criteria are among the established, widely announced, and 
distributed sets of goals and objectives for all Hawaii students. They have been 
judged by Hawaii educational personnel ^as highly significant in the development 
of young people. TheVinding Of no differences between 3 on 2 and self-contained 
students suggests, once again, failure of 3 on 2 to enhance the attainment of a 
common set of learning objectives. 
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O^e of Affective Subtests . Both teams supported strongly the Importance of 

data 'describing the performance pupils In the affective domain if the efficacy of 

\ 

the 3 on 2 organizational scheme weVe to properly ascertained. After carefully 
e^ssessing the availability of such instruments, the Student Attitude Inventory, with 

seven subscales, was* compiled from well-known attityde scales published by the 

22 ' 
Instructional Objectives Exchange. There were no differences in the affective 

subtest scores. The students, regardless of classroom organization, poss^ess for ----- 

23 

the most part positive attitudes toward themselves, their class, and their schopl. 

Summary Comments " 

The Advocate Team argutfs for retention of the 3 on 2- Program mainly on the 
basis of presumed logical advantages , logic that has worn thin over, the years, 
when one considers (a) the absence 'pf pupil outcome achievement data favoring the^ 
program and (b) the presence of a $10 million price tag next year which. will 
continue t'o grow in the ^^ears ahead. 

No doubt, as a diversionary technique in the absence of supporting data, the 
Advocate Team elected to attack self-contained classroom^, the evaluation study 
design, and the entire range of tests used in the evaluation. 

The team coulcf'not counter the facts that learning outcofne data failed to shoW 
any advantages of 3 on 2 over self-contained classro^^ and that teachers and 
parents generally described the progress and behavior of their students and 
children in the same way--no discernible differences attributable to classroom 
organization. The only consistently supportive evidence presented by the Advocate 
Team was information from the principals' questionnaire. Principals tend to like 
3 on 2. The observed discrepancies, however between the principals' views and 
pupil performance data together with the judgments of teachers and parents, who 
each day work with /these students, prompts one to wonder, if the myriad of daily 
administrative tasks does not overshadow the principals' capacity to keep abreast 
of the performance of groups of children in each class. 
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The' Advocat* Team's claim that "thre^-^|^hers and 60 or ^^o children simply 



have it better than one teacher and 25 children," was put in perspective by oSie 
teacher whd noted, "As a teacher, I prefer a 3 on 2 situation; but for my own) 

children, I requested self-contained classrooms for them, knowing the kind of 

\ - ; -\ 24 . " 

concern an^J teaching they wcfuld be receiving. ' 

The Adversary Team has acknowledged the few valid points registered by\t\e 

Advocate Team, and has pointed out glaring weaknesses^ c/f the Report, weaknesses 

which are legion. Much of the Report contained postfcj photographs which couldf^. 

just as easily have been made in self-contained classrooms, ahd'f ictional 

stories of children. - Fiction is fiction wherever it is found, but fiction in 

an evaluation report is more than- a l^ittle disconcerting. 
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■ FOOTNOTES 



. 3 Oh 2 Evaluatidh Report 1976-77. Vol. I#rechn1ca1 Report. iPOrt- . 

Tand, OR: ' Northwest Regional EducfctlajwFTaboratory, Jar\yary, 1977. 

2. W. James Pop Ham, Dale Carlson, Thomas R, Oweps, and Michael D. 
, .Hiscox. 3 on t EvelUatlon H^Pg^t ]976-77j . Vol « }iI. Team Interpret 
tatlons and Reccynnendat^ons . Portland. OR; Northwest fteg tonal 
Wugat^onal Laboratory, January 1977. 

3. - -A^ -example of :the unusual manner-ln which -these-data wre re^^^ 

by the Adv„ocate Team 1$ contained on page 16 of the team's Riaportl 
"...for the 37 percent who perceived «• difference in the effective- 
ness of" reading Instruction, 84 pe»S:ent favored 3 on 2." On thiy 
item, 31 percent favored 3 on ,2; 6 , percent favored self-contained; 
and 67 percent saw no differences. This 1s an examplr;«Cjthe team's 
claim that, "Some of the comparisons are astonishingly favorable 
toward the Hawaii 3 on £ Program," even with two-thirds of the 
respondents, who saw no differences In pupil effectiveness In the 
two classroom organizations. 

4. See Technical Report , Table 1-1.9 

5. See Technical Report , Table I-l.lO 

6. See Technical .Report , Table-I-1.8 

7. See Technical Report , Table H-4.4 
8. 

9. See Technical Report , Table 1-1.17 . 
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10. See Technical Report , Chapter IV. 

11. The six "advantages" can be found in the following documents: 
(1) The 1968 .Conference Committee Report #3 . Hawaii State Legis- 
lature. pp. 9-10; (2) 3 on 2 Administratiye^Guide and Jmplementation 
Handbook , Third Revision, July 1973; and (3) Report of Meeting on 

3 on 2: Review of Conference Committee Report #3 , January 29, 1974 . 

12. See Technical Report , Table H-4.4. s 

13. See Technical Report , Table H-4.4.S 

14. See Technical Report , Appendix M 

15. See Technical Report , Table H-1.2 



See Technical Report , Appendix 

IK ' 



V 



. -.A 



ERIC 



113 



16. See Technical Report. Observation No. 22, Appendix M ^ 

/ 

17. See Technical Report , Af)pendix M 

18. See Technical Report , p. 22, for-a description of Test Selection 
Procedures . ^ . 

19. 3 on 2 Lonq-Ranqe Program Improvement Plans. 1974-77 . Hawaii Depart- 
ment of Education, July 1974. 

2(k Th'is position was reinforced by discussions with Protessor L^e 
Cronbach of Stanforfd University about this controversy. 

;> 21. See TechnlcaT Report , pp. 34-36, for a description of Test Selection" 
Procedures. " 

22. See Technical Report , p. 57, for a description of Test Selection 
Procedures . . 

23. See Technical Report , Chapter V. 

24. Response on open-end question of Teachers Questionnaire for Grades K-3 
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